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I. Introduction 



I n 1995, the Chicago Annenberg Challenge 
launched a six-year, $150 million initiative to im- 
prove C hi cago's public schools. It set out a broad 
vision for change, calling for the "enhancement of 
learning for all students through dramatically im- 
proved classroom practice and strengthened commu- 
nity relationships." 1 The Challenge was organized 
around a strategy that called for schools with com- 
mon interests and needs to form networks to work 
together to improve. Each network was required to 
have an "external partner," an individual, group, or 
organization that would help promote local school 
improvement. Networks and external partners were 
supported by monetary grants and by a variety of pro- 
fessional services provided by the Challenge. This 
strategy followed a logic that schools that worked to- 
gether and with an external partner would find greater 
support for local improvement and be more success- 
ful than if they worked alone. 

Annenberg external partners were to perform a 
number of different functions. T hey were to serve as 
f i d uci ary agents of A n n en berg grants to th e n etwo rks. 
They wereto bring human, material, and intellectual 
resources to support network development and local 
school improvement. T hey were to catalyze and sus- 
tain school improvement and help develop local lead- 
ership. External partners were also encouraged by the 
Challenge to bring or help raise additional financial 
resources for their schools and networks to support 
local improvement activity. I nitially, theC hallengesaw 
networks as the primary agents for local school im- 
provement and external partners as resources for the 
networks. Overtime, however, as networks struggled 
to develop and function effectively, theexternal part- 
ners became more and morecentral to theC hallenge's 
strategy for promoting local school improvement. 2 

The Chicago Challenge made two types of grants 
to schools and external partners. Early in its opera- 
tion, the Challenge distributed small amounts of 
money in one-year planning grants to help schools 
and partners develop their networks and their plans 



for school improvement. T hese networks of schools 
and partners, along with others that might not have 
received planning grants, could also apply for imple- 
mentation grants. Implementation grants made avail- 
able larger sumsof money to carryout improvement 
plans. They usually supported several years of activ- 
ity and could be renewed. 

T heC hicago C hal lenge awarded most of its imple- 
mentation grants in two major waves. 3 Thirty-four 
networks received initial funding between 1995 and 
1996; the rest first received funding 1997. TheC hal- 
lenge funded no new networks thereafter. Notably, 
three-quarters of networks and partners who had 
funding in 1997 received continuation grants until 
the end of the Challenge. Several networks and part- 
ners lost their support during the 1998-1999 school 
year, but from spring 1999 through 2001, the C hal- 
lenge supported the same 45 networks and external 
partners. 

In 2000, theC hicago Annenberg Research Project 
issued a report focused on the work of Annenberg 
external partners from thebeginning of theC hallenge 
through 1999. 4 T hat report described the nature of 
the work Annenberg partners were doing in schools, 
the strategies they used to work with teachers and 
school communities, their successes and failures, and 
the challenges they faced within and outside the 
schools. The overall impact of their work, as the 
Challenge's primary agents of school improvement, 
on schoolsand on student learning isdocumented in 
other reports of the Research Project. 5 While these 
other reports indicate that as a whole Annenberg's 
external partners were not particularly successful in 
promoting improvement across the large number of 
schools, it is nevertheless instructive to look to them 
to learn from their experiences and to hear them tell 
the lessons they learned from working with schools 
for extended periodsof time. Asagroup of 45, across 
the six years of the Challenge, Annenberg partners 
accumulated some 210 years of experience working 
with schools to help them improve. The 19 partners 
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who formed the sample for this report accumulated 
nearly 100 years of experience. T hese partners have a 
lot to say. 

T his report presents thethoughts and observations, 
the collective wisdom, of Annenberg external part- 
ners about a wide range of topics. The report looks 
back on the work of the partners between 1995 and 
2001, to what they said they learned about the chal- 
lenges of working with schools, thekeysto successful 
school improvement and the causes of failure, and 
thesupportthey needed but did not always get to do 
their work well. This report also looks forward, pre- 
senting Annenberg partners' views about the future 
of external partners as agents of local school change. 



The next section of the report begins by introduc- 
ing An nen berg's external partners and their work. It 
then describesthevariouscontextsin which the part- 
ners worked— the Chicago Annenberg Challenge as 
theorganization that sponsored and supported them; 
the policies and practices associated with Chicago 
school reform; and the individual schools partners 
were to help improve. These descriptions of the 
Annenberg partners and the contexts of their work, 
drawn primarily from other reports of the research 
project, framethevoicesof thepartners in subsequent 
sections. 
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How This Report Was Prepared 

This report wasprepared with data collected from 19 Annenberg external partners. 1 These partners first received support 
from the Challenge during the 1996 and 1997 waves of grant making and continued to receive Annenberg support 
through the end of the Challenge in 2001. These partners were selected for study in spring 1997 and were chosen to be 
generally representative of the group of partners that received support from the Challenge at that time. These 19 partners 
represent 42 percent of An nen berg’s 45 external partners receiving funding between 1999 and 2001. AsTable2 and Table 
3 in the next section show, these 19 partners were also similar in organizational type and in experience working with 
schools to the larger group of partners supported by the C hallenge. 

The data for this report come primarily from interviews. Data also comefrom reports and other documents produced 
by the partners and submitted to the Chicago Challenge to describe their work and accomplishments. Additional data 
comefrom field notes of observations of Challenge and partner-sponsored activities and from correspondence from the 
Chicago Challenge staff to the partners. 

Persons working as Annenberg external partners were sampled and then interviewed at three points during the life of 
the Challenge— 1997, 1999, and 2001. This interview sample was developed in 1997 by first inviting to be interviewed 
the person named by the partner organization to be its primary Annenberg agent. The invitation provided that these 
persons could identify one or more colleagues to be interviewed with them or in their stead. This strategy produced a 
sample that grew in size each year. In 1997, 26 persons were interviewed and in 1999, 29 persons were interviewed. In 
2001, 49 persons were interviewed. D uring that last round, as many as six persons associated with a single partner organi- 
zation were interviewed. O bservations of Challenge and partner-sponsored activities were conducted several times each 
year between 1997 and 2001. Also included were relevant data from observations of earlier Challenge- sponsored activities. 
Those observations were collected as part of the broader Chicago Annenberg Research Project. 2 A primary observer at- 
tended most Challenge-sponsored events, took notes, and collected all printed materials distributed at these events. Occa- 
sionally, another member of the research project would attend the events in place of the primary observer. At least once a 
year, documents pertaining to external partner and network activity were collected from the partners and from the Chal- 
lenge offices. These documents included proposals for implementation grants, progress and financial reports required by 
the Challenge of all networks and partners, and variousprint materials provided thepartnersto their schools. 

Each year, the persons interviewed were asked similar questionsso that their responses could be compared across years. 
They were asked questions about (a) the partner organization’s central purpose and mission; (b) its strategy for working 
with schools and how and why this strategy may have changed over the years; (c) the partner organization’s capacity for 
working with schools (human, intellectual, financial, material, etc.); (d) the activities the partner organization engaged in 
with schoolsto promote improvement; (e) theconditionsand resources that made "partnering" successful or unsuccessful; 
(f) the guidance and support received from the Chicago Challenge; (g) what the partner organization may have learned 
and might do differently in its future work with schools; and (h) the role that external partners might play in promoting 
school improvement in Chicago in the future. With the consent of theperson(s) interviewed, the interviews were tape 
recorded and transcribed for analysis. 

Data from interviews, observations, and documents were read and coded by the report’s authors according to emergent 
themes and patterns. 3 Presentations of initial findings were made to Annenberg external partners in December 2001 and 
April 2003. Their comments, suggestion sand insights were used to guide our analysis. In the end, we organized this report 
around those themes and patterns that reflect the predominant perceptions of the partners in the study or of a specific 
group of partners (e.g., partners working with high schools, community-based partners, etc.). 

It is important to note that this report presents the self-reports and reflections of the partners, what they said they did, 
what they saw, what they thought, and how they explained things. These self-reports and reflections are subject to the 
biases and self-interests of the partners and are not corroborated by independent data. 



1 The identities of the partners in this sample are confidential . 

2 See Shipps et al. (1999b). 

3 M erriam (1998); Stake (1995); Yin (1989). 
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II. Meet the Partners 



A nnen berg's external partners were a large and 
diverse lot. T hey were of different organiza- 
tional types. They varied in the experiences 
they had working with schools before Annenberg. 
These partners worked with different numbers of 
schools. And, they varied in what they sought to ac- 
complish. 



Partner Characteristics 

Tablel presentsAnnenberg's45 external partners and 
the number of schools in their networks in 1999, the 
middle year of data collection. T hese partners repre- 
sent a wide range of organizational types. As shown 
in T able 2, more than one-third of all Annenberg part- 
ners were based at universities. Twenty-three percent 
were from cultural institutions that included muse- 
ums and arts organizations around the city. Another 
28 percent of the partners were educational reform 
and service organizations. These organizations in- 
cluded local education advocacy organizations, na- 
tional and local school reform projects, and teacher 
associations. Finally 14 percent of Annenberg's part- 
ners were community organizations such as neigh- 
borhood associations. Table 2 also shows the 
organizational typesof the partners that were sampled 
for study. Thesample has roughly similar proportions 
of organizational types as the whole group of 
Annenberg partners. 

M ost Annen berg external partners had someexpe- 
rience working with schools before the Challenge. 
H owever, as shown in T able 3, only about two-thirds 
of them had previously worked with schools in the 
type of long-term, collaborative improvement initia- 
tives that Annenberg supported. One-third of 
Annenberg partners had no such experience working 
with schools. Asshown in T able 3, thepartnersin the 
study sample were similar to all Annenberg partners 
in this regard. 



0 f the different types of partners that Annenberg 
supported, university-based partners were most likely 
to have had established working relationships with 
the schools in their networks before the C hallenge. 
Moreover, most university-based partners that were 
interviewed expressed intentions to continue work- 
ing with their schools after their Challenge grants 
expi red and to look to other sourcesfor grantsto sup- 
port their work. Community-based partnershad also 
worked with schools before Annen berg, however, most 
had focused exclusively on promoting community and 
parent involvement. W hen theyjoined theC hallenge, 
their work shifted to areas in which they had little 
experienceor expertise, such as curricular and instruc- 
tional improvement and improvement of student aca- 
demic achievement. All but one of the education 
service organizations in the study sample had long- 
standing, ongoing relationships with the schools in 
their networks that predated the Challenge. Finally, 
thecultural institutionsthat becameAnnenberg part- 
ners typically had some experience working with 
schools or with groups of teachers before the Chal- 
lenge, but asa group they had not had theexperience 
of multiyear, collaborative school development work 
that theC hallenge required. These organizations had 
the steepest learning curve of all the partners. 



Foci of Partners’ Work 

Annenberg External Partners focused their work with 
schools on a number of different areas of improve- 
ment. About 55 percent organized their activities 
around curricular and instructional improvement. 
Sixteen percent aimed to improve student learning 
climate and social services for students and families. 
Another 13 percent were concerned primarily with 
parent and community support and development. 
The remaining 16 percent adopted more compre- 
hensive foci, working to develop a number of areas 
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Table 1: Chicago Annenberg External Partners and the Numbers of Schools in 
Their Networks, 1999 



Annenberg External Partners 


N of Schools 


Academic Development Institute 


3 


Association of Illinois Middle Level Schools 


3 


Beverly Area Planning Association 


6 


Chicago Children’s Museum 


3 


Chicago Metropolitan History Education Center 


4 


Chicago State University 


8 a 


Chicago Symphony Orchestra 


3 


Chicago Teachers Union — Quest Center 


3 


Coalition for Improved Education in South Shore 


9 


Coalition of Essential Schools Regional Center at Chicago 


6 


Columbia College — Science Institute 


3 


DePaul University School of Education 


4 


Designs for Change 


5 


Erickson Institute 


3 


Facing History and Ourselves 


3 


Garfield Park Conservatory Alliance 


4 


Governors State University 


3 


Great Books Foundation 


4 


Hug-A-Book 


3 


Illinois Future Problem Solving 


5 


Illinois Learning Partnership 


3 


Illinois Resource Center 


3 


Imagine Chicago 


4 


Kohl Children’s Museum 


3 


Logan Square Neighborhood Association 


5 


Loyola University 


4 


National Louis University — Center for City Schools 


4 


National Louis University — Faculty 


6 


Near Northwest Neighborhood Association 


5 


Northeastern Illinois University — Chicago Teachers Center (Group A) 


3 


Northeastern Illinois University — Chicago Teachers Center (Group B) 


3 


Northeastern Illinois University — Chicago Teachers Center (Group C) 


3 


Northeastern Illinois University — Chicago Teachers Center (Group D) 


3 


Northeastern Illinois University — Chicago Teachers Center (Group E) 


4 


North Lawndale Learning Community 


9 


Participation Associates 


3 


People’s Reinvestment Development Effort 


3 


Roosevelt University 


5 


Success for All Foundation 


3 


Suzuki-Orff School for Young Musicians 


4 


Teachers Task Force 


3 


University of Chicago — Center for School Improvement 


8 


University of Illinois at Chicago — Small Schools Workshop 


15 b 


Whirlwind Performance Company 


3 


Youth Guidance 


12 



Source: Chicago Annenberg Challenge. Notes: This list contains External Partners of networks with 
implementation grants in 1999. a These eight schools are schools within four larger schools. b These 15 
schools include some independent small schools as well as small schools within nine larger schools. 
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Table 2: Types of Organizations Represented Among 
Annenberg External Partners 





Percentage of All 
Partners (N = 45) 


Percentage of Study 
Sample (N = 19) 


University-Based Organizations 


35% 


42% 


Cultural Institutions 


23% 


21% 


Educational Reform and Service Organizations 


28% 


21% 


Community-Based Organizations 


14% 


16% 



Table 3: Percentages of Annenberg External Partners with Experience Working 
with Schools on Long-Term Improvement Projects 





Percentage of All 
Partners (N = 45) 


Percentage of Study 
Sample (N = 19) 


With Experience on long-term projects 


30 (67%) 


13 (68%) 


Without Experience on long-term projects 


15 (33%) 


6 (32%) 



Table 4: Primary Foci of Annenberg External Partners’ Work with Schools 



Foci of Work 


Percentage of Partners 


Curriculum and Instruction 


55% 


Student Learning Climate and Social Services 


16% 


Parent and Community Support and Development 


13% 


Comprehensive 


16% 



concurrently, including curriculum and instruction, 
teacher professional community, school leadership, 
student learning climate, and parent and community 
support. 

Annen berg's partners pursued a number of differ- 
ent strategies to promote improvement in these ar- 
eas. 6 M any introduced new programs of professional 
development for teachers, princi pals, and other school 
leaders. These programs created opportunities for 
participants to share experiences and engage in joint 
problem solving. They engaged teachers in technical 
training in literacy instruction, the use of technology 
in the classroom, integration of arts into the curricu- 
lum, health/science education, and other curricular 
innovations. They also provided training in strategic 
school improvement planning processes. The part- 
ners helped develop new staff support for instructional 



improvement. Using their Challenge grants, a num- 
ber of partnerswereableto hiredemonstration teach- 
ers, literacy coordinators, and resident artists. Some 
new support staff members were brought in from 
outside schools through the partners' organizations, 
but some were hired from among the teachers in the 
partners' schools, creating new opportunities for 
teacher leadership. 

Some partners also used Annenberg funds to de- 
velop and distribute new instructional materials to 
schools. These materials included children's literature, 
new systems of student assessment, and plans for 
teaching specific types of lessons. Other partners 
helped schoolsto create new organizational structures 
to support school improvement activity. Somehelped 
develop small schoolsor schools-within-schools. 0 th- 
ershelped schools restructurethei r days to banktime 
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for regular teacher professional development. Still 
others helped schools develop new committee struc- 
tures to promote collaborative planning and decision 
making within schools and among schools in part- 
ner^ networks. 

During the course of the Challenge, most 
Annenberg partners altered or refined their initial 
strategies to increase their effectiveness with schools; 
to respond to the Challenge's evolving agenda for 



school improvement, particularly its growing empha- 
sis on instruction and student achievement; and to 
deal with the Chicago Public Schools' policy initia- 
tives, especially thoseconcerning high-stakes account- 
ability. Such changes in partners' strategies are 
discussed in the last section of this report that focuses 
on the partner^ own learning and the development 
of their capacity to serve as resources for school im- 
provement in the future. 
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III. The Contexts of Partners’ Work 



U nderstanding Chicago Annenberg external 
partners and what they have to say about 
promoting local school improvement re- 
quires some understanding of the various contexts in 
which they worked. Annenberg partners worked 
within the strategic orientation and organization of 
the Chicago Challenge. They worked within the 
broader context of systemwide school reform policy. 
They also worked within the specific contexts of in- 
dividual schools. This section of the report examines 
each of these contexts, but first it provides a bit of 
history of the emergence of external partnersin Chi- 
cago. T hat the idea of external partners had been es- 
tablished prior to the Chicago Challenge created a 
precedent for the Challenge to look to partners as 
agents of school improvement. 

The Precedent for Partners 

In turning to external partnersto support local school 
improvement, the Chicago Challenge built upon a 
precedent that had been developing in the Chicago 
Public Schoolssincethemid- to late-1980s. 7 Thel988 
decentralization reform required that every school in 
theChicago Public School system develop and imple- 
ment an annual school improvement plan. The re- 
form also granted new budgeting authority to local 
schools that allowed them to hire individuals from 
community groups, universities, and other organiza- 
tions as consultants or service providers to support 
local improvement efforts. At the same time, a num- 
ber of Chicago- based philanthropic foundations be- 
gan to provide grants to a wide range of external 
organizations to work with schoolson local improve- 
ment efforts. These foundations, among them the 
M acArthur Foundation, thejoyce Foundation, and 
theChicago Community Trust, provided funds to 
external organizations to support a wide range of ac- 
tivity, including training programs for Local School 
Council members, curriculum development projects, 
establishment of small schools, teacher professional 



development, and research on the progress of school 
reform in the city. 

Concurrently, theChicago Public Schools began 
to turn to external organizations as a resource for its 
own school improvement initiatives. In 1994, Super- 
intendent ArgieJ ohnson proposed a plan that would 
categorize schools in three groups based on student 
achievement as measured by standardized achievement 
tests and other indicators of academic progress. 
Known as the "three-tier plan," it proposed to offer 
"support for all [schools], recognition for many, and 
intervention for some." Under this plan, the system 
would provide to schools, upon request, assistance 
from a newly "re-engineered" central office, district 
offices, and a wide rangeof "assistance groups. "These 
groupsincluded universities, education reform groups, 
and community organizations. 

While the three-tier plan was never implemented 
underjohnson's administration, it provided additional 
precedent for turning to external organizations to 
support local school development. By the time the 
founders of the C hicago C hallenge wrote the initial 
proposal to bring an Annenberg grant to the city, 
many CPS schools had already begun to work with 
outsideorganizationsto help them develop and imple- 
ment annual school improvement plansmandated by 
the 1988 reform. M oreover, after the 1995 reform, 
the system continued to look to external organiza- 
tions as resources for local school improvement, as- 
signing them to work with schools on academic 
probation. 

T he idea of external partners was not anomalous 
to Chicago. Throughout thecountry, educational re- 
form networks were growing in number and in im- 
portance. Such networks connected schools not only 
to each other but also to outside organizations. 8 Sev- 
eral other local Annenberg Challengesacrossthecoun- 
try wereorganized around strategies involving school 
partnerships with outside organizations. Indeed, in 
describing the organizing principles of the national 
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Annenberg Challenge, a group that coordinated, 
monitored, and supported the work of local Chal- 
lenges, theAnnenberg Institute wrote: 

TheChallengeencourages whole-school reform 
through partnerships in which individual schools 
often group themselves into clusters, families, 
or networks; schoolsalso link with 'external part- 
ner^ such as a university, cultural institution, 
community group, local business, or reform or- 
ganization. 9 

Building upon such precedent, the Chicago Chal- 
lenge incorporated external partners into its strategy 
for promoting local school improvement. We now 
turn to a description of the Challenge as a context in 
which the partners operated. 

The Chicago Annenberg 
Challenge 

The Chicago Annenberg Challenge sought to pro- 
mote local school development through networks of 
schools and their external partners. It followed a logic 
that schools that worked together with an external 
partner would find more direction and support for 
development than if they acted alone. Since its estab- 
lishment in 1995, the Challenge operated much like 
a foundation. 10 It distributed its resources through 
planningand implementation grantsto networks and 
external partners and provided some professional as- 
sistance to grant recipients. The Challenge did not 
articulatespecific goalsfor individual school improve- 
ment to schools or to the external partners. I nstead, 
it called for teachers, parents, and communities to 
rethink and restructure the basic elements of school- 
ing, with external partners serving as guides and re- 
sources in the process. Rather than specify programs 
that schoolsshould adopt, theC h al I enge believed that 
educators, parents, and community members should 
identify their own ways to solve local problems and 
address local needs. 

The Chicago Annenberg Challenge followed the 
principles of the national Annenberg Challenge, a 
group associated with theAnnenberg Institute that 



coordinated, monitored, and supported the work of 
local Challenges. These principles were described in 
1998 by the Institute as follows: 

An abiding tenet of the Annenberg Challenge 
since its inception— one that distinguishes it 
from other major school reform initiatives— is 
its embrace of pluralism. Believing that there is 
no magic bullet, no single panacea, for fixing 
what ails our nation's most troubled schools, the 
Challenge has eschewed privileging one reform 
strategy over another. Rather, like all pluralist 
efforts, the Challenge accommodates an array 
of theories, in this case about how change oc- 
cursin schoolsand in thesystemsof which they 
are a part. And like all pluralist efforts, its con- 
stituent elements are characterized by both simi- 
larities and differences. 11 

While the Chicago Challenge did not have spe- 
cific goalsfor school improvement nor did it specify 
programs or processes for schoolsand partners to fol- 
low, it did set particular directions for local school 
i m p ro vem ent activity. I nitially, theC hicago C hallenge 
focused on three basic problems of school organiza- 
tion that were seen as obstacles to improvement: (a) 
the lack of time for effective teaching, student learn- 
ing, and teacher professional development; (b) the 
large size of school enrollment and instructional 
groups that hindered the development of personal- 
ized, supportive adult-student relationships; and (c) 
schools' isolation from parents and communities 
which reduced their responsivenessto local needs and 
their accountability to their most immediateconstitu- 
ents. The problem of isolation was extended to in- 
clude teachers' isolation from one another, which 
could limit opportunities for teacher learning and 
development, innovation, and professional account- 
ability. In making its first grants, the Challenge re- 
quired school networks and their partners to address 
oneor moreof theseorganizational problems. There- 
after, the C hallenge encouraged schoolsand external 
partners to focus more specifically on teaching and 
learning, teacher professional development, and 
whole-school change, not just change among groups 
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of teachers with in schools. W i thin these general areas 
of emphasis, partners had broad latitudeto work with 
schoolson specific local issuesin waysthattheschools 
and partners saw fit. Indeed, as described in the pre- 
vious section of this report, Annenberg partners and 
their schools focused on a wide range of school im- 
provement activity and employed widely varying strat- 
egies to achieve their goals. 

The Challenge provided two general types of sup- 
port to its partners to work with schools. The first 
typeof support was money distributed through plan- 
ning and implementation grants. Thesecondtypewas 
various forms of professional support. As described 
below, both types of support were relatively modest. 

In its first few years of operation, the Challenge 
distributed small amountsof money in one-year plan- 
ning grants to schools and external partners to help 
them develop their networks and their plansfor school 
improvement. These schools and partners, as well as 
others that might not have applied for nor received 
planning grants, could then apply for implementa- 
tion grants, which made available larger sums of 
money to carry out their plansfor school improve- 
ment. Implementation grants usually supported sev- 
eral years of activity and could be renewed. 12 Grant 
money could beused in any number of different ways 
and the partners were designated fiduciary agents of 
these funds. 

The total amount of money provided to schools 
and external partnersthrough implementation grants 
grew considerably between 1995 and 1999. 13 This 
increase coincided with the growing number of 
schools and external partners funded during this pe- 
riod. At its peak in 1999, the Challenge distributed 
$9.6 million to support local school improvement 
activities. Between 1999 and 2000, total funding was 
reduced by almost 40 percent, to $5.9 million. By 
2001, total funding was reduced to about $526,000, 
one-tenth of thefunding provided in 2000. 

T heamount of money that individual partnersand 
schools received was relatively modest. Between 1996 
and 1999, this amount of money increased, even as 
the number of partners and schools that the Chal- 
lenge supported increased. In 1999, at the peak of 
funding, partners received, on average, about 



$160,000 to work with an average of four to five 
schools. W hile the partners spent these resources in 
many different ways, in practical terms, the money 
that year was about enough to provide salaries, ben- 
efits, and support to two professional staff members 
to work across the partner's schools. After 1999, the 
average amount of money partners received declined 
substantially with the total amounts that the C hal- 
lenge distributed. Initial budget requirements set by 
theC hicago Challenge stipulated that partnerscould 
use up to 10 percent of their grants to support their 
own expenses. The remainder had to go directly to 
the schools or beused by the partners in direct ser- 
vice of the schools. Later, the Challenge recognized 
that to be more effective, the partners themselves re- 
quired more resources, and it altered this requirement 
to allow for larger percentages of grant monies to be 
kept by the partners. 

Whilethesefundswereallocated differently among 
schools, it is useful to examine levels of average per- 
school funding to gain another sense of the level of 
Annenberg resourcesthe partners and theschools had 
to work with. An average amount of funding per 
school was calculated on the basis of the total amount 
of implementation grant moneys disbursed and the 
total number of schools supported by the Challenge 
in a given year. These figuresdo not separate out how 
much money of a grant was used bytheexternal part- 
ner itself. Still, as total Annenberg funding increased 
between 1996 and 1999, average funding per school 
rose from about $15,000 to almost $47,000. Astotal 
funding fell andthetotal number of schoolsand part- 
ners supported by the Challenge remained constant, 
average per-school funding dropped considerably, 
from about $47,000 in 1999, to $29,000 in 2000, to 
about $2,600 in 2001. Even at its peak in 1999, the 
average per-school funding from Challenge grants 
comprised only a small percentage of atypical school's 
budget. The average per-school funding level of 
$47,000 represented about 1.2 percent of theannual 
operating budgets of elementary schools studied in 
this research project. 14 This percentage does not take 
into account other grants that schools might have 
obtained, in which case the Annenberg portion would 
be even smaller. 



10 Improving Chicagcfs Schools 



In addition to funding, the Chicago Challenge 
provided its schools and external partners different 
formsof professional support. In 1997, theC hallenge 
sponsored workshops to help schools and partners 
develop stronger plans for school improvement and 
stronger proposals for Challenge funding. Some 
schools and partners received direct coaching on the 
development of their programs and proposals. That 
year, the Challenge also held workshops for schools 
and partners on the themes of time, size, and isola- 
tion. Challenge staff provided workshopsto promote 
its vision of successful school improvement. These 
workshops tapped a few successful Annenberg part- 
ners to serve as trainers and facilitators. Also that year, 
in an effort to promotecommunication and learning 
among schools and partners, the Challenge printed 
the first of several directories listing its implementa- 
tion grant networks and their member schools and 
partners. T hesedirectoriesalso contained descriptions 
of the primary foci of network and partner activity. 

These initial forms of professional support were 
followed by another strand of workshopsdesigned to 
provideopportunitiesfor schoolsand partners to share 
ideas and engage in joint problem solving. These 
workshops were also designed to bolster commitment 
to local improvement efforts. Additionally, theC hal- 
lenge sponsored presentations by outside speakers, 
someof whom werenational figu resin school reform. 
Finally, the Challenge organized fairs for schoolsand 
partners to display their work and celebrate their ac- 
complishments. Theseformsof support arediscussed 
further in Part V of this report. 

The chief responsibility for providing these and 
other support activities fell primarily to one member 
of the Challenge staff, a program director, who was 
hired to develop programs, obtain resources, and pro- 
vide professional support to schools and partners. A 
grants manager and the Challenge's executive direc- 
tor joined the program director in this effort. Both 
the program director and the grants manager had 
some, but not extensive, experienced school improve- 
ment. The executive director was hired from the lo- 
cal foundation community. H is primary experience 
had been in grant making and community develop- 
ment. Perhaps because of economies of scale, in the 
later yearsof the initiative, theC hallenge staff worked 



more closely with external partners rather than work- 
ing more directly with individual schools. 

In addition to providing professional support, the 
Challenge established a reporting and accountability 
system that required partnersto submit detailed writ- 
ten budget and activity reports twice each year, docu- 
menting and explaining their expenditures, their 
activities, and their accomplishments. As discussed 
later in this report, most Annenberg partners found 
these requirements to be onerous and thought that 
they detracted from their work with schools. 15 

Chicago Public School Reform 

Annenberg partners also worked in the broader con- 
text of school reform in thecity. 16 T heC hicago C hal- 
lengewas established with a grant from the Annenberg 
Foundation in January 1995. It was aligned with the 
principles of democratic localism and grassroots ac- 
tion inherent in Chicago's 1988 decentralization re- 
form (Illinois PA85-1418 School Reform Act). The 
Challenge sought to extend what isconsidered Phase 
I of C hicago school reform, from governance to other 
areas of school improvement, notably teaching and 
learning. TheC hicago C hallenge wasdesigned on the 
assumption thatthecentral administration atthetime 
would be in pi ace for the foreseeable future and that 
decentralization and local school governance would 
be the foundation for school improvement for some 
time to come. 

Six months after the Challenge was established, 
everything changed. The Illinois legislature passed the 
1995 amendment to the 1988 reform bill (Illinois 
H B206), which ushered in Phase 1 1 of reform. This 
amendment restructured the central administration 
through thecreation of a corporate-style management 
team that included a Chief Executive Officer to re- 
place the superintendent, and a five- member Reform 
Board of Trustees appointed by the M ayor. It estab- 
lished greater accountability within the system by 
clarifying and extending the authority of theCEO to 
intervene in nonimproving schools. 

Shortly after the Chicago Challenge began award- 
ing its first network grants, the new central adminis- 
tration introduced two major initiatives that brought 
centralized, high-stakes accountability into the sys- 
tem. It placed schools with less than 15 percent of 
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students scoring at or above national norms on the 
lowaTestsof Basic Skills (IT BS) on academic proba- 
tion and assigned each a probation manager to direct 
school improvement efforts. Schoolson probation that 
failed to improve their test scores over a period of 
time could be reconstituted. T he administration also 
developed anew policy to end social promotion. Stu- 
dents in third, sixth, and eighth grade were required 
to meet specified cutoff scores on thelTBS in order 
to advance to the next grade level. If they failed to 
meet these benchmarks, they had to attend summer 
school, and if they failed again attheend of thesum- 
mer, they were retained. 

A year later, the administration developed new 
systemwide goals and standards for student learning. 
It began to create lesson plans keyed to these stan- 
dards across grade levels and curriculum-specific ex- 
aminations for high school graduation. It also began 
a major capital improvement initiative to build new 
schools, repair and renovate existing facilities, and 
alleviate overcrowd ingin manyschools. It established 
the Lighthouse program to provide after-school aca- 
demic, recreational, and social learning opportuni- 
tiesfor students. It also began to place more emphasis 
on early childhood education. 

Against this backdrop of centralized initiatives and 
test- d ri ven acco untability, theC hallenge madegrants 
to support local school development activity. As noted 
earlier, it first emphasized theorganizational issues of 
time, size, and isolation. Later, it intensified itsfocus 
on teaching, learning, and whole school change. In 
particular, the Challenge began to promote intellec- 
tually challenging instruction and teach er p rofessi o n al 
development. It encouraged teachers to analyze their 
students classroom work to stimulate instructional 
improvement. 

There were several areas where the school system's 
initiatives and the Challenge's efforts to promote 
school development were consistent and mutually 
supportive. For example, at some Annen berg schools, 
the system's capital development efforts were instru- 
mental in developingleamingdimatesthatweremore 
conducive to teaching and learning. 17 On the other 
hand, the Challenge and its external partners pro- 
moted school improvement activitiesthat sometimes 
collided with and competed against specific system 



policies, creating tensions and dilemmas for princi- 
pals and teachers at the school and classroom levels. 
N owhere were the tensions and dilemmas between 
the Challenge and the system more sharply pro- 
nounced than in the interaction between high-stakes 
standardized testing and efforts to improve instruc- 
tion. Other reports of the Chicago Annenberg Re- 
search Project have indicated that in some Annen berg 
schools, high-stakestesting, coupled with thesystem's 
probation and student retention policies, played a 
crucial, even positive role in creating a press for ac- 
countability and a perceived need for change. 18 At 
the same time, in some schools, high-stakestesting 
pushed teachers and principals to focus on the 
quickest meansof administrative compliance— test 
preparation— and abandon, or push aside at least 
forawhile, partners' effortsto achieve more ambi- 
tious, long-term instructional improvement. Of- 
ten this meant giving Annen berg-sponsored efforts 
low priority. 

It was in these evolving reform contexts of pushes 
and pulls, of compatibilities and contradictions, that 
Annenberg external partners worked with schools to 
help improve them. 

The Schools with Which 
Partners Worked 

Asa group, Annen berg external partners worked with 
a large number of schools across the Chicago Public 
School system. The number of schools in Annenberg 
implementation networks rose from 138 in 1996 to 
211 in 1998. From 1999 to 2001, that number re- 
mained steady at 206. In all, theChicago Challenge, 
through its external partners, extended support to 
nearly 40 percent of schools in the system. 

Structural and Demographic 
Characteristics 

As shown in Table 1, the typical Annenberg external 
partner worked with four or five schools. A few part- 
ners worked with as many as 16 schools. M ost of the 
schools with which Annenberg partners worked were 
elementary schools. Indeed, about 90 percent of all 
the schools that the Chicago Challenge supported 
wereelementary schools. Asshown in T able 5, almost 
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Table 5: Percentages of Annenberg External Partners Working with Different 
Combinations of Elementary and High Schools 





Percentage of All 
Partners (N = 45) 


Percentage of Study 
Sample (N = 19) 


Working only with High Schools 


2% 


0% 


Working with Elementary Schools and One 
High School 


35% 


37% 


Working only with Elementary Schools 


63% 


63% 



two-thirds of Annenberg's external partners worked 
exclusively with elementary schools. A little more than 
one-third worked with elementary schools and one 
high school. 0 nly 2 percent worked exclusively with 
high schools. Whilethe majority of partners worked 
only with elementary schools, almost 40 percent of 
Annenberg partners faced the task of working with 
more organizationally complex and challenging high 
schools. Table 5 also shows that the sample of part- 
ners that were studied was similar in this regard to all 
partners that Annenberg supported. 

The schools with which Annenberg partners 
worked were very similar as a group to schools 
throughout the system as a whole. Table 6 shows the 
characteristics of elementary schoolssupported by the 
Challenge during the 1998-1999 school year. Recall 
that schoolsthat received support from theC hallenge 
that year continued to receive support through 2001. 
Overall, substantial proportions of students in 
Annenberg schools scored below national norms on 
both reading and math portions of thelTBS. More 
than one-third of students who graduated from their 
schools dropped out before graduating from high 
school. M uch likeother Chicago elementary schools, 
Annenberg elementary schoolsserved primarily Afri- 
can-American and Latino students. Eighty-five per- 
cent of these students camefrom low-incomefamilies. 
Almost one-fifth of thestudentsin Annenberg schools 
were enrolled in bilingual education. 

School Capacity 

Another important aspect of the schools with which 
Annenberg partners worked was their capacity to en- 
gage effectively in Annenberg's approach to reform. 
ThomasTimar and David Kirp have argued that the 
success of school reform initiatives depends in sig- 



nificant ways on the capacity of schools to engage in 
and implement those initiatives effectively. 19 In their 
words, schools need the "institutional competence" 
to fulfill effectively the demands of reform. By insti- 
tutional competence, Ti mar and Kirp refer to theas- 
pirations, commitments, and norms of a school that 
direct its work and its efforts to improve. They also 
refer to the knowledge and skills of teachers and ad- 
ministrators to respond to the reform, to implement 
it, and to achieve its objectives. They argue that re- 
formsare more likely to succeed if they are consistent 
with theaspirations, commitments, and normsofthe 
school, and if those in the school who must imple- 
ment the reforms possessthe requisite knowledge and 
skills to do so. Others have made the same general 
argument. 20 For instance, Gene Hall and Shirley 
Hord, among others, have pointed out the impor- 
tance of a school's state of "readiness and its initial 
commitments to an innovation to the long-term 
implementation and effectiveness of that innovation. 21 

A primary organizing themeof theChicago Chal- 
lenge was the empowerment and self-determinism of 
local actors, members of school communities work- 
ing in networks with their external partners, to im- 
provetheirown schools. Closely related to thistheme 
of local initiative and self-determinism wasthetheme 
of capacity building. The Challenge called on the 
schools and external partners it supported to build 
organizational capacity by addressing the issues of 
time, size, and isolation. It challenged schools and 
partners to build capacity for instructional improve- 
ment through teacher professional development. At 
thesametimethat it challenged itsschoolsand exter- 
nal partners to build capacity, the Challenge made 
certain assumptionsthatschoolsand partners already 
possessed somerequisitecapacity to engage in thesort 
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Table 6: Characteristics of Chicago Annenberg Elementary Schools and 
Elementary Schools Citywide, 1998-1999 





Annenberg 

Schools 


Schools 

Citywide 


Average student enrollment 


696 


706 


Percent low-income students 


85% 


85% 


Percent English-language learner 


18% 


18% 


Racial/ethnic composition 






• Percent African-American 


53% 


54% 


• Percent Latino 


33% 


34% 


• Percent White 


10% 


9% 


• Percent Asian/Pacific Islander 


3% 


4% 


• Percent Native American 


< 1% 


< 1% 


1993 Eighth grade students who: 






• Graduated from a CPS high school 


40% 


40% 


• Dropped out 


35% 


36% 


• Left CPS 


25% 


24% 


Students in grades three through eight scoring at or 






above national norms on the ITBS 






• Reading 


36% 


35% 


• Math 


43% 


42% 



Note. Percentage of low-income students is percentage of student eligible for the federal free or reduced- 
price lunch program. 



of decentralized, self-determined, collaborative work 
of local capacity development that it promoted. 

A case can be made that in order for schools to 
successfully engage in the Challenge's "style" of re- 
form, that is, for schoolsto "do Annenberg" well, they 
had to possess some base of human, social, and mate- 
rial resources that would support collaborative devel- 
opment work within schools, among schools, and with 
external partners. This base of resources might well 
consist of inclusive collaborative leadership, strong 
working relationships among teachers, and strong 
relationships between theschool and parents. Schools 
would also have to have some base of commitments 
to the Challenge and to the approach to reform that 
it promoted. Indicators of such commitments might 
well includethealignmentof Annenberg'sgoalswith 
the school's own goals for improvement, the cen- 



trality theschool would giveto theAnnenberg ini- 
tiative among other initiatives it might be pursu- 
ing, and the commitments of people and time to 
make the effort work. 

In theC hicago Annenberg Research Project's final 
technical report, these indicators of school capacity 
to "do Annenberg" are examined in substantial de- 
tail . 22 A few of these indicators are presented below. 
Overall, these indicators show that Annenberg part- 
ners worked with schoolsthat asa group varied widely 
in their capacities to support the demands of the 
Challenge. Coupled with potentially strong internal 
sourcesof disruption and persistence, such widevaria- 
tion in capacities no doubt complicated the work of 
Annen berg's external partners. 

In citywide surveys administered by the Consor- 
tium on Chicago School Research, principals of 
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Annenberg schools were asked whether their schools 
had enough of their own resources— staff, time, and 
other resources— to make participation in Annenberg 
activities "pay off." In both 1997 and 2001, princi- 
pals were mixed in their assessments of the adequacy 
of the resources thei r own schools possessed to make 
Annenberg participation "pay off." In 1997, 45 per- 
cent of Annenberg principals disagreed or strongly 
disagreed that their schools had enough resourcesfor 
participation in Annenberg to makesuch a difference. 
In 2001, roughly the same percentage of principals 
considered their own schools^ resources inadequate. 

Data from the 1997 Consortium citywide teacher 
survey providesomeindication of the strength of key 
human and social resources among Annenberg schools 
early in the Challenge that might beused to support 
school development. As shown in Table 7, substan- 
tial proportions of Annenberg schools scored in the 
weakest categories of measures of these resources. 23 
That year, 17 percent of Annenberg schools reported 
minimal and limited orientation to innovation. In 
these schools, relatively few teachers were reported to 
try new ideas and take risks to improve their practice. 
There was substantial disagreement that teachers were 
continually learning, were encouraged to grow, and 
had a "can do" attitude. N o teachers or only some of 
theteachersin these schools were reported to try new 
ideas and take risks to improve their practice. Sub- 



stantial percentages of Annenberg schools also re- 
ported weaknesses in various aspects of school lead- 
ership. Twenty-four percent of Annenberg schools 
reported minimal principal support for change. In 
addition, 18 percent of Annenberg schools reported 
weaknesses in principal instructional leadership. In 
24 percent of Annenberg schools, teachers reported 
that their principals promoted parent and commu- 
nity involvement but they disagreed that their prin- 
cipalsworked to create a sense of community in their 
schools or were committed to shared decision mak- 
ing. Finally, 36 percent of Annenberg schools reported 
weaknesses in joint problem solving. While teachers 
reported general openness of expression in their 
schools, they indicated that problems and conflicts 
wereoften ignored or avoided. 

Substantial percentages of A n n en berg sch oo I s al so 
reported weaknesses in different aspects of teacher 
professional community in 1997. One-quarter of 
Annenberg schools reported limited levels of peer 
cooperation and collaboration. A similar percentage 
of schools reported that teachers engaged only occa- 
sionally in reflective dialogue about their teaching. 
About one-third of Annenberg schools reported weak 
focuson student learning and a very limited senseof 
teacher collective responsibility for student learning 
and school improvement. Substantial percentages of 
schools also reported weaknesses in relational trust. 



Table 7: Percentages of Annenberg Schools and the Weakest Categories in which 
They Scored on Measures of Human and Social Resources to Support School 
Development, 1997 



Measures 


Categories 


Percent of 
Schools 


Orientation toward Innovation 


Minimal and limited 


17% 


Principal Support for Change 


Minimal 


24% 


Principal Instructional Leadership 


Mixed 


18% 


Inclusive Leadership 


Mixed 


24% 


Joint Problem Solving 


Weak 


36% 


Peer Collaboration 


Limited 


25% 


Reflective Dialogue 


Occasional 


24% 


Focus on Student Learning 


No focus and not very focused 


31% 


Collective Responsibility 


Very limited and limited 


33% 


Teacher-Principal Trust 


Minimal 


21% 


T eacher-T eacher T rust 


None and minimal 


54% 


Teacher-Parent Trust 


Minimal 


42% 


Parent Involvement 


Minimal and limited 


39% 
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Twenty-one percent of Annenberg schools reported 
minimal levels of trust between teachers and princi- 
pals. M ore than half of the schools reported no trust 
or minimal trust among their teachers. Forty-two 
percent reported minimal levels of trust between 
teachersand parents. Finally, 39 percent of Annenberg 
schools reported minimal and limited levels of par- 
ent involvement. 

It is important to note that some of these human 
and social resources grew stronger in Annenberg 
schools between 1997 and 1999, including inclusive 
leadership, principal instructional leadership, focuson 
student learning, and teacher-parent trust. 24 In addi- 
tion, teacher participation in professional develop- 
ment activity and the quality of the professional 
development activity they experienced improved 
among Annenberg schools during this time. In al- 
most all cases, however, these improvements were lost 
after 1999. 

T here is another side to the issue of school capac- 
ity. In addition to the various resources that schools 
may have to support improvement, schools also have 
sourcesof internal disruption and persistencethat can 
complicate and compromise partners' work. There is 
some evidence, for instance, that Annenberg schools 
as a whole experienced substantial turnover among 
their faculties, and such turnover may have made it 
very difficult to make and sustain much school de- 
velopment. 0 n theConsortium principal survey, prin- 
ci pals of Annenberg schools reported that, on average, 
they hired 25.2 newteachersto their schools between 
1995 and 2001, which is, on average, 3.6 teachers 
per year. Between 1999 and 2001, they reported hir- 
ing an average of 9.7 new teachers or an average of 
3.2 teachers per year. According to the Chicago Pub- 
lic Schools, the average size of an elementary school 
faculty is 26.3 teachers. W hile number of new teach- 
ers hired is not necessarily the best indicator of turn- 
over in a school (it doesn't take into account the 
numbers of teachers who leave a school), it does give 
us some indication of the change or "churn" in per- 
sonnel that is taking place within the school. Taking 
the number asa rough indicator, on average, the num- 
ber of new teachers hired by Annenberg schools be- 
tween 1995 and 2001 represented between 12 and 



14 percent of their entire faculties each year. Data 
from CPS personnel records indicatethat these prin- 
cipal reports underestimate the numbers of teachers 
who came to their schools each year. For example, 
these records indicatethat on average, for the 1997- 
1998 school year (the latest data avai lable for this re- 
port), 15.7 percent of teachers in Annenberg schools 
were new to their schools that year. This percentage 
is the same as the percentage of teachers in non- 
Annenberg schools who were new to their schools. 

In addition to changes in teaching staffs, the loss 
of key leaders can threaten school improvement ef- 
forts. Between 1996 and 1999, there were a number 
of documented instances from the research project's 
field research schools where the loss of curriculum 
coordinators— hired and trained by Annenberg part- 
ners and paid for by C hallenge grants to work with 
teachers— all but terminated the progress achieved 
through the schools' main improvement efforts. 25 In 
other field research schools, improvement efforts 
stalled when theprincipalswho initiated them retired 
or left for other schools. 

D ata from Consortium teacher surveys and from 
field research provide evidence that some Annenberg 
schools had cultures that were much moreconducive 
to change than other Annenberg schools. Recall that 
in 1997, almost one-fifth of Annenberg schools had 
minimal or limited orientations toward innovation 
(seeTable7). Another indicator of whether a school 
culture may be conducive to change is the expecta- 
tions that teachers hold for their students learning 
and for their futures. It may be very difficult to en- 
gage schools and teachers in improvement activity if 
teachers hold relatively low expectationsfor their stu- 
dents. That is, if teachers do not think that their stu- 
dents can learn or be successful, they may also believe 
that efforts to change schools may be for naught. 

Two items on the 1997 teacher survey give some 
indication of the range of expectations that teachers 
in Annenberg schools held for their students. T hese 
items asked teachers the percentages of thei r students 
who they believed would graduate from high school 
and the percentages of their students who they be- 
lieved would go on to attend a two- or four-year col- 
lege. T able8 showsthedistributionsof responsesfrom 
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Table 8: Expectations of Teachers in Annenberg Schools for Their Students’ 
Educational Futures, 1997 





Percentage of 
Annenberg Teachers 


Percentage of the students 1 teach who 1 expect will graduate from 
high school: 




• 1 to 25 percent. 


4% 


• 26 to 50 percent. 


13% 


• 51 to 75 percent. 


35% 


• 76 to 100 percent. 


48% 


Percentage of the students 1 teach who 1 expect will attend a two or 
four-year college: 




• 1 to 25 percent. 


23% 


• 26 to 50 percent. 


27% 


• 51 to 75 percent. 


29% 


• 76 to 100 percent. 


21% 



Annenberg teachersto these two items in 1997, early 
in the Challenge. As this table shows, teachers in 
Annenberg schools held a range of expectations for 
the students they taught. Some of these expectations 
arequitelow, perhapscontributing to school cultures 
thatwerenot particularly conduci veto improvement. 

0 ur field research revealed that Annenberg exter- 
nal partners sometimes encountered school cultures 
that confounded their efforts to promote school de- 
velopment. Partners sometimes butted up against a 
culture among teachersof privacy and autonomy that 
madediffi cult efforts to promotejoint problem solv- 
ing and co 1 1 ab o rat i ve p rof essi o n al development. 26 Sev- 
eral Annenberg partners that were interviewed 
observed that someteachers with whom they worked 
believed that si nee previous reform initiatives seemed 
never to be sustained— that they came and went with 
changes in school administrators— it was not prudent 
for them to invest serious effort in new reform initia- 
tives. Similarly, partners reported that in a number of 
cases, principals with whom they worked were either 
unwilling or incapableof infusing partner-sponsored 
activities into their schools. As in the case of some 
teachers with whom the partners worked, some prin- 



cipals appeared to partners to be "victims" of an ad- 
mi n i strati ve cu Itu re that worked agai n st the partn er£ 
goals for school development. 27 

Another sourceof problems was program overload 
and fragmentation from the many improvement ini- 
tiatives that Annenberg schools had adopted. This 
issue is discussed in greater detail in subsequent sec- 
tionsof this report. H ere, it is important to notethat 
even the earliest interviews with Annenberg partners 
revealed that partners' work with schools often com- 
peted with other initiativesforteachersand adminis- 
trator^ timeand attention. In these cases, Annenberg 
partnerswho tried to promote whole-school improve- 
ment found that they had limited influence. In later 
interviews, more than half of the partners reported 
that their schools were involved in so many pro- 
grams besides Annenberg that "it was often diffi- 
cult to get the schools to pay serious attention to 
[their] programs." 28 

Thescopeof this problem in Annenberg schools is 
suggested by data from theConsortium principal sur- 
veys. Both 1997 and 1999 surveys asked principals 
to repo rt th e extent to wh i ch t h ey saw th e A n n en berg 
Challenge as just one of many programs they had at 
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Table 9: Percentages of Principals of Annenberg Schools Who Agreed with the 
Statement, “The Annenberg Challenge is just one of many programs we have at 
this school,” 1997 and 1999 





1997 


1999 


Strongly Agree 


20% 


15% 


Agree 


57% 


65% 


Disagree 


21% 


18% 


Strongly Disagree 


1% 


3% 



their schools and the degree to which their teachers 
devoted time to Annenberg activities as opposed to 
other projects at their schools. Principal^ responses 
to these items are shown in T ables 9 and 10. In 1997, 
77 percent of Annenberg principals agreed or strongly 
agreed that the Annenberg Challenge wasjust oneof 
many programs they had at their schools. In 1999, 
80 percent of Annenberg principals agreed or strongly 
agreed. In 1997, more than half of Annenberg prin- 
cipals disagreed or strongly disagreed that of all exter- 
nal projects in their schools, most teacher time was 
devoted to Annenberg activities. In 1999, a similar 
proportion of Annenberg principals made the same 
assessment. Taken together, these pieces of evidence 
strongly suggest that Annenberg partners faced com- 
petition for time, attention, and effort from other 
improvement initiatives in a substantial number of 
the schools with which they worked. This competi- 
tion may have made quite difficult efforts to engage 
schools in Annenberg activity in a way that would 



Table 10: Percentages of Principals of 
Annenberg Schools Who Agree with the 
Statement, “Of all external projects, most 
teacher time is devoted to Annenberg 
activities,” 1997 and 1999 



lead to significant, lasting improvement. 

Ironically, both Annenberg principals and exter- 
nal partners noted throughout thecourseof thisstudy 
that, although the Challenge identified it as a crucial 
problem to address, lack of time was a persistent im- 
pediment to efforts to promote school improvement. 
As discussed earlier, substantial proportions of 
Annenberg principals reported on both 1997 and 
2001 surveys that their schools lacked the staff, time, 
and other resourcesto makeparticipation in network 
activity really "pay off" for their schools. An earlier 
report of the Chicago Annenberg Research Project 
noted that half of the principals interviewed identi- 
fied lack of time as a specific impediment to their 
school^ participation in network activitiesduring thei r 
f i rst year of funding. 29 E ach of these pri nci pals poi nted 
to lack of timeto attend network meetingsthemselves 
or to send members of their staffs. The problem of 
time was also identified in initial interviews of 
Annenberg partners. A substantial number of part- 
ners observed that the structure of the normal school 
day, combined with the plethora of programs requir- 
ing teacher participation, restricted thetimeavailable 
for teachers and administrators to focus on the part- 
ners' programs. 30 





1997 


1999 


Strongly Agree 


12% 


13% 


Agree 


35% 


37% 


Disagree 


50% 


48% 


Strongly Disagree 


3% 


3% 
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IV. Lessons on Promoting School Improvement with 
External Partners 



W ithin these complicated, competing, and 
not altogether supportive contexts of the 
Chicago Challenge, school reform and 
the Chicago Public Schools central office, and the 
schools themselves, Annenberg partners went about 
thebusinessof promoting local school improvement. 
As indicated earlier in this report, their efforts were 
not widely successful. 31 At the same time, the part- 
nersobserved and experienced a great deal duringthe 
years they spent working with schools. From their 
observations and their experiences— successful and 
unsuccessful— the partners that we interviewed of- 
fered a number of lessons they learned about how to 
promote school improvement. In this section and 
those that follow, we turn directly to the partners. In 
three sets of interviews across five years, they told us 
about their experiences working with schools, those 
things that supported and constrained their efforts, 
and thevaluethey thought they brought to theschools 
with which they worked. 

In this section we present four areas of "lessons 
learned" about promoting school improvement us- 
ing external partners as agents of change. T hese areas 
focus on the importance of school leadership, com- 
munication and relational trust, issues of coherence 
and coordination, and the need for adequateand sus- 
tained levels of resources to support improvement. 
As we mentioned earlier, these areas reflect the pre- 
dominant views of the partners. For instance, every 
partner we interviewed spoke about the importance 
of strong and supportive school leadership, be it in 
the context of active or uncooperative principal sup- 
port or about the role of teacher leadership or shared 
leadership in improvement activity. Likewise, nine- 
in-ten partners we interviewed spoke about the im- 
portance of communication and relational trust. 



The Importance of 
School Leadership 

All of the partners spoke at length about the need for 
strong, supportive leadership in order for their school 
improvement initiatives to succeed. This leadership 
wasfrequently embodied by the principal, butteacher 
leaders and shared leadership were also seen by part- 
ners as important for successful school improvement. 

Principal Leadership 

Partners consistently named the principal as the 
"make-or-break" factor in creating a strong partner- 
ship between a school and its external partner. 0 ne 
partner told us, "The principals in these school shave 
the power to create a culture of I earning and collegial 
support or to utterly undermine it." Another said, 
"At the school level wehavecometo seetheprincipal 
as the key player in this restructuring effort and we 
have learned that without the participation, without 
the leadership of the principal, any thought of restruc- 
turing schools was nearly impossible." The positive 
support of the principal was always a boon for the 
work of the partners, but even a neutral principal was 
preferable to one who was uncooperative. 0 bserved 
another partner: 

Some principals get it more than others, some 
principalssign on no matter what, some princi- 
pals question this or don't question that, some 
principals don't really get it. . . . But, no matter 
how powerful and how wonderful, and how 
much leadership is exhibited [by teachers], the 
principal is still a principal and can throw a 
wrench into anything at anytime. 
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On the positive side, most partners spoke of prin- 
cipals who were instrumental in helping them pro- 
mote their agendas for school improvement. These 
principalsactively monitored instructional quality in 
their schools and worked to ensurethat their schools' 
programswere consistent with theapproach to school 
improvement promoted by the Annenberg partner. 
One partner described thetypeof principal most sup- 
portive of its work this way: 

The principal is very important, someone who 
actually understands and doesn't just take on 
whatever comeshisor her way. . . . For example, 
Principal X actually has read the books, and ac- 
tually knows what [our instructional improve- 
ment method] means, and actually can go into 
a classroom and be able to see that kids are do- 
ing what he thinks is right. 

Thistypeof principal support can be cultivated over 
time, as another partner explained: 

In two of our schools we have really succeeded 
in making the principals much more partners 
with us in what wedo. We have frequent meet- 
ings with them, we poured out a plan with them 
and the project does not operate as some kind 
of graft onto thesystem. We insist that the prin- 
cipals beat thegoverning committee meetings. 

I probably never write a memo from us alone 
[but always include] the principal. We didn't 
have that kind of cooperation in the previous 
years. It was more I ike we were in there doing a 
project typeof thing, and that isthevery thing 
that we were trying to transcend. 

Partners found they depended on strong school 
leadership to develop wide support for the school 
improvement ideasthey promoted. They looked par- 
ticularly to principalsto promote teacher involvement 
in partners' activities and to hold teachers account- 
able for following through in their classrooms. One 
partner concluded from his experience working with 
schools that: 



There has to be a critical core [of people] at the 
school that wants to partner, that wants to 
change and that valuesan external partner. There 
has to be a principal that has to do something 
about the people who aren't motivated to be 
involved. 

Extending Leadership to Teachers 

Partners also discussed the importanceof other sources 
of leadership in the school to support and help sus- 
tain school improvement, particularly strong teacher 
I eadersh i p. A 1 1 but two of the partn ers we i ntervi ewed 
described specific efforts they madeto includeteach- 
ers in decision-making and to develop teacher leader- 
ship. One partner told us: 

We always work with the schools^ leadership, 
meaning principals, but we started with the 
teachers. We were teach ers first, and then as the 
ground swell of teacher involvement began to 
grow we were able to start working more di- 
rectly with the school leadership. The princi- 
pals, the local school council, wealwayswent in 
right from the beginning to the local school 
council and presented material, but I don't think 
we ever went to the local school council until 
we had already connected with the teachers, so 
we didn't speak for ourselves on this. We went 
in with teachers speaking. 

Several partners observed that it was important to 
develop a critical mass of teacher leaders in a building 
to beableto initiateand sustain school improvement 
activity. D eveloping a singleteacher leader wasoften 
not enough. 0 ne partner recalled: 

We had in our design originally one teacher 
leader who would bea liaison to the project with 
Annenberg. I think that was dead on smart, but 
I don't think we did it enough. One teacher 
leader in a school probably isn't enough; wethink 
that principals need to haveteamsof peoplewho 
they can work with and depend on, and it al- 
most has to have a little leadership training or- 
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ganization going on in the school where they 
are finding and rewarding teachers and possibly 
even others to take on the leadership role. 

The partners understood well that teacher leader- 
ship would provide little "added value" to school im- 
provement if their principalsdid not have confidence 
and trust in their ability. They knew that they had to 
have principal understanding and support for broad- 
ening the base of leadership in their schools. And 
many of the partners sought to develop that support 
through collaborativedecision-making processes con- 
cerning their work with the schools. One partner de- 
scribed it this way: 

Our mission was to transform teaching and 
learning, and to build a strong teacher leader- 
ship base. T hat was our mission. But, we also 
knew that wecouldn't do this without the build- 
ing principal. So we knew that we'd have to get 
them involved. And wedid that in thisnetwork. 

As a matter of fact, there were no planning ses- 
sions where teachers and the administrators did 
not sit down together to make all the plans for 
how weweregoingto implement some process. 
There was a collegial kind of environment we 
created for both schools and external partner- 
ship. Wewereequally involved in learningfrom 
each other. 

Several partners used meetings of principals and 
teachers across their networks to build leadership ca- 
pacity at the school level. Another partner described 
such activity this way: 

We have regular principal collaborations, shar- 
ing of ideas to foster school leadership, and to 
encourage that, develop it. We have regular cross 
network events with teachers, and lead teachers 
are coming together regularly, and they really 
arecentral in their school. So they really areable 
to share together, able to come out and go back 
to their school and share ideas, and you now 
build off of them. 



Several partners observed that such efforts to ex- 
tend and strengthen leadership across teacher and 
administrator roles had the potential to "snowball" 
or spread beyond an initial group to a broader num- 
ber of teachers. 

As people get good at leadership, they learn for 
themselves, and they [can give up some power]. 

N udging them to go ahead and give that em- 
powerment to somebody else. "You had prac- 
tice on this. Can you think of something else 
that you would I ike to do?" You know, that gentle 
nudging. "You learned this, you're a go-getter. 

H ow about we think of a new role for you?" 

Such spread held out prospectsfor building deeper, 
wider bases of leadership to support school im- 
provement. 

Communication and Trust 

If they werenot aware at the beginning, the partners 
said they quickly learned that each school with which 
they worked was a unique organization with its own 
strengths and weaknesses. Coming from outside the 
school, partners found that they had to learn to be- 
come a part of the school community if they were to 
be successful. And in order to become part of the 
school community, the partners reported that they 
often had to overcome formidable barriers to com- 
municatingwith schools. They also had to build trust- 
ing working relationships not only between them and 
their schools but also among teachers, principals, and 
parents with whom they worked. They learned that 
it was often quite difficult to develop trust without 
effective means of communication. 

Communicating with Schools 

To the partners, one of the most frustrating aspects 
of working with their schools was the difficulty in 
communicating directly with school personnel. Com- 
munications systems that partners took for granted 
in their own settings— individual access to phones, 
voicemail, and e-mail— were either unavailable or 
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inoperable in manyAnnenberg schools. The partners 
found that theschools with which they worked relied 
primarily on centralized telephones and fax machines 
for communicating with theoutside world. They told 
us that elementary schools typically had only one fax 
machinefor the entire school, and thephoneand fax 
machinewereboth located in themain office, farfrom 
most teachers' classrooms. All of the partners wrestled 
with one type of communication problem with 
schools or another. 

Partners who needed to reach individual teachers 
directly could rarely do so. They had to rely on their 
schools' internal communications systems. Simple 
tasks, such as relaying telephone messages, could not 
be relied upon, as this partner observed: 

The quickest thing is putting a note in [a 
teacher's] mailbox, but calling and leaving a 
message, that'sjust not [effective]. That's the last 
resort. 

Another partner said, 

If I had to change the schedule [of a meeting] 
around or to check on something, getting a hold 
of somebody in theschools was just incredibly 
difficult, and you could by no means count on 
a phone message being delivered. 

Even in the few schools where they were more avail- 
able to teachers, phones were not always the best 
meansfor communications. Asone partner recalled: 

We have one school where each classroom has 
its own phone. And I am always fearful that I 
shouldn't be calling now they're in the middle 
of teach in g.T hey don't have voicemail, they just 
have that phone there. 

Most partners wished they were able to usee-mail 
and Internet forcommunicating with theschools. But 
at the time of our interviews with partners in 2001, 
few schools were wired. Even those schools that were 
wired had not prepared their staffs to use the tech- 
nology routinely. 0 ne partner said, "I never use the 
e-mail if I want them to know something, because I 
know it doesn't get checked." I nternet access and use 



was very uneven from school to school. Recalled an- 
other partner: 

That has been a frustration all along. It's been 
a frustration with the Board because one of 
our schools was promised it would be wired 
and that never happened. N ow they have all 
been wired [from the street] to the door but 
that doesn't mean anything now, because it's 
not [wired] inside. 

Some partners descri bed pri nci pals as bei ng at the 
heart of the problem with using technology. 0 ne part- 
ner recalled: 

In our network the principals are way behind 
thetimesin using the I nternet. They say dumb 
things like "you are never going to catch meon 
that." Now it's as ridiculousas saying "I am never 
going to pick up a book" or "you won't see me 
reading a book." 

Another partner related this story about how diffi- 
cult it wasto introduce electronic communication to 
theschools: 

0 ne year we bought laptops for all of the prin- 
cipalsand [our network's] literacy coordinators. 
And we had our staff hereto train them. And 
among the people who were being trained were 
everyone from those who needed to be told 
"H ere's the button you punch to turn it on," to 
those who already had some experience with a 
PC . Wethreatened. 0 netimewesaid we weren't 
going to send any more faxes, that they would 
have to get [computer] literate. We paid for e- 
mail for our network. And we said we weren't 
going to communicate with them any other way. 
And there are still some principals, to this day, 
who just can't be communicated with unless you 
fax them. 

Occasionally a school, especially one with a deter- 
mined principal, overcamethese problems. 0 nepart- 
ner recalled: 
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0 neof our former schools was internally wired, 
that principal just went ahead and did that. [H e 
was] very technologically savvy, but the rest of 
the schools have been really slow. 

The partners who worked in schools where Internet 
access was available found it an extremely useful tool 
f o r co m m u n i cat i o n . 0 n e of th ese partn ers reco u n ted : 

At one school they have e-mail, and they also 
have an internal e-mail system so you can send 
a message to one person, and then ask them to 
send it out through the internal network. So 
there's a huge advantage there. T hey use it as a 
means of communication. T he principal sends 
out broadcast messages and they know the 
teacher leader also sends out broadcast messages 
to everybody. T hey have a wealth of means of 
communications, and habitsof communicating 
with each other. 

Given the problemsthey experienced, the partners 
we interviewed found that they had to be creative in 
order to communicate with schools. H alf of the part- 
ners with whom we spoke said that they bypassed 
thei r schools' formal communicationschannels. Some 
partnersused paper flyers in teacher mail boxes astheir 
primary meansof communication. Several others also 
developed newsletters. 0 ne partner told us: "We do 
a Round Robin newsletter that starts at one school 
and keeps adding." Another partner recounted: 

Wesent out weekly bulletins. I wrotethemand 

1 faxed it, usually M onday morning or late Fri- 
day afternoon, so it got there M onday morn- 
ing. And the principals had agreed that what 
they would do is get it photocopied and put in 
teacher's mailboxes. 

Another partner said: 

Every week on Monday all mycoordinatorsand 
my principals receive a weekly updatethat I do, 
just kind of a "H ere's what's going on, here's 
what's coming up" little newsletter. Those are 



posted wherever the teachers are, the teachers 
room or sometimes at the swipe machine 
[timeclock] at the front desk. 

Another partner recounted, "They don't read e-mail. 
Telephone, fax, mail, and showing up in person are 
the best ways. Wearein constant contact with them." 

And still another told us: 

Wefaxalot, we send out a lot of fliers, a lot of 
information, but we really don't use the I nternet 
with the schools very effectively. It's difficult to 
do because they are not all set up to be able to 
communicate that way. They really need more 
resources to be able to do that. 

M ost of the partners who tried to make use of the 
Internet had to rely on teachers who use e-mail at 
home. Others simply relied on cal ling teachers on the 
phone after school hours. 0 ne partner said: "There 
are a lot of late night calls at home." M any partners 
had I ists of teachers' home phone numbers, and part- 
ners also freely distributed their own home phone 
numbersto teachers and principals. 

Finally, someprindpalsfound that the best way to 
communicatewith schools was the most direct— hav- 
ing a physical presence in the school. One partner 
told us: 

Wearebigon making that stop in theschool to 
say hello to certain teachers, to say hello to cer- 
tain people. That's where you get a real slice of 
theschool and you get to really talk to the prin- 
cipal or to someone in two seconds to see how 
they are reacting on certain days. We are in the 
schools a lot. 

Going to the school allowed for more personal en- 
counters. Another partner recounted, "I have found 
that the human connection that you make [when] 
the teachers/staff and parents see you in theschool 
physically is really effective." M aking an effort to be 
in the school makes other means of communication 
mo re effective, as another partner reflected: 
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Part of the challenge is not just getting the in- 
formation to them but really connecting with 
them so they'll pay attention to information, so 
it means more to them, so they feel a personal 
contact there. So, "0 h, gee, maybe I 'll cometo 
that," because you had this conversation about 
it or they heard about it in a meeting when they 
actually put together the date. I find that hard 
and very important. We're pretty good at doing 
flyers now and getting that out, but the follow 
up, that's time intensive but very important. 

A number of thepartnersweinterviewed appointed 
and trained people within schools who could act as 
liaisons. Literacy specialists, parent coordinators, and 
outside consultants all spent a lot of time in schools 
and could relay messagesfrom the partners. 0 nepart- 
ner who adopted this strategy told us: 

The way we are organized, we have facilitators 
responsible for a few schools and they are on 
site there. T hey are regularly in the building a 
number of days each week. 

Another partner told us: 

I really, really rely on the coordinators to get 
the information out to theteachers, and then 
to get the teacher's feedback or anything. I 
really rely on thecoordinatorsto givemethat 
information. 

These and other partners found that persistence was 
often essential in communicating. For example, one 
recalled: 

[W ]hen we were recruiting for [our summer 
institute], the consultants went teacher to 
teacher, door to door, you know, and 20 times 
brought them the form. 

Thecreation of coordinator positions was, accord- 
ing to some partners, a triumph of trust in some 
schools. Several partners told usthat principals, who 
once wanted to control the flow of information, had 
learned to let go as the partner came to be seen as a 



trusted, long-term al ly. 0 ne partner descri bed the long 
road to efficient communications in its network: 

We have a person in each school called the co- 
ordinator that is actually a disseminator of in- 
formation. There is a structure to this, because 
they get paid a stipend for this, to make sure 
that principals know whereto bewhen they are 
supposed to be, and committee members know 
where to be when the meetings happen, and 
special events and that kind of stuff. It wasn't 
until about two years ago that the principals 
actually went for that idea, and they went for it 
because they realized the amount of stuff that 
they were getting, and they started to finally re- 
alize how much work it was to get information 
to the schools, and so two years ago they allowed 
us to finally go to the system of having a point 
person, and that hasjust helped so tremendously. 

I think the principals finally got to the point 
where it's a release of control. T hey had to feel a 
comfort level with usand our ability beforethey 
would allow this type of a process to happen in 
theschools. So I think it saysa lot that theorga- 
nization was able to grow to the point where 
they would allow a coordinator from the school 
to be responsible underneath them. 

A Foundation of Trust 

As suggested by the passage above, trust was seen by 
thepartnersweinterviewed as an essential ingredient 
in working effectively with schools. Partners consis- 
tently pointed to the importanceof trust asa founda- 
tion for risk-taking and changeon the part of teachers 
and principals. Some partners anticipated the need 
to develop trust from the beginning of their work with 
schools. Others acknowledged that they had under- 
estimated the importance of trust but had come to 
realize that they had to work consciously and dili- 
gently to develop it even in later years of their work. 

0 ne partner explained that in orderto accomplish 
much of anything with theschools, "There had to be 
trust, trust in [the] external partner. [Theschools had 
to think that] it wasn't just somebody else coming in 
to do something to you.” Another partner said: "The 
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[thing that] is the most important is that the princi- 
pals trust you, and they trust that the programming 
that you aredoing isgoingto bein their school's best 
interest." 

Another said: 

We say we work for the best interest of the chi I- 
dren, and we are doing this so that you can do 
your job. I think that people have to learn that 
we really mean that, I don't think they trust that 
in the beginning, because that's not how schools 
operate. [Teachers are used to a] "you are here 
to observe me and give me a bad rating and get 
me fired" kind of suspicion. 

Partners emphasized repeatedly in interviews that 
building trust takes timeand patience. Someobserved 
that only in the later years of their relationships with 
schools had teachers become trusting enough to re- 
ally commit to the work that they wereto do together. 
0 nepartner remarked, "It took really the whole year 
and a half to build enough trust in the network that 
anyone wanted to be together." Another partner re- 
called that early efforts to work with schools had gone 
slowly in large part because of an absence of trust: 

A lot of that had to do with the trust process, 
getting to know the [external partner organiza- 
tion], getting to know us as individuals, and 
trusting that we weren't going to do anything 
horrible. It also had to do with the principals 
trusting their faculty [who worked with us] to 
make sound choices and decisions. 

The partners reported that they used a variety of 
strategies to cultivate trust among school personnel. 
W hi le bui Idi ng trust was not always the pri mary ob- 
jective of these strategies, the partners considered it a 
powerful by-product. Several partners told us of net- 
work-wide retreats they organized with thei r schools. 
They described these retreats asopportunitiesfor joint 
planning, professional learning and development, and 
also time for partners, teachers, and administrators 
to get to know each other better outside the context 
of school, to work together, and to build relational 



trust. Even those partners who were not cognizant of 
the importance of trust-building early in the Chal- 
lenge came to see the value of retreats as mechanisms 
for developing stronger working relationships with 
their schools and promoting collaboration among 
school personnel. 

Some partners to Id us of role-specific, cross-school 
networks they created to strengthen trust relationships 
among different school personnel. Such networkswere 
formed for librariansand media specialists, social-ser- 
vice providers, and principals. One partner explained 
how meetings of these networks helped to build pro- 
fessional connections and relational trust: 

We built trusting relationships among the 
people, so that when they see each other in a 
different context, they know each other. T he li- 
brarian at oneof theschoolssaid, "Oh now when 
I go to thedistrict librarian meeting we all hang 
out and talk to each other and share ideas and 
have coffee." I think especially for people who 
don't have any real professional network, they 
may have professional development conferences 
that they go to, but there isn't a network kind of 
within the school that supports their own pro- 
fessional development. I think they found each 
other to be resources, they sort of feel I ike they 
built a community. 

0 ther partners descri bed how they sought to develop 
trust through teacher and parent book clubs or brief 
sabbaticals that gave teachers an opportunity to ob- 
serve, collaborate with, and learn from other teach- 
ers. In any case, whether successful at building trust 
or not, partners identified it as a crucial element for 
working effectively with schools. 

Coherence and Coordination 

In addition to leadership and communication and 
trust, the partners we interviewed had a great deal to 
say about the importance of coherenceand coordina- 
tion of school improvement activity. The partners 
recognized the importance of coherence in instruc- 
tional programsfor teaching and student learning. 32 
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They also recognized the importance of coherence 
among different improvement initiatives in which a 
school might be engaged. M ost pointed to the ad- 
vantages of working with schools with clear and co- 
herent programs of improvement. According to the 
partners, coherence in school improvement activity 
created a singularity of focus and sense of purpose. It 
reduced competition for school resources as well as 
staff time and attention. And, it increased a school's 
chances for success. 

In its research on school reform in Chicago, the 
Consortium on Chicago School Research used the 
phrase, "Christmas tree school," to refer to those 
schoolsthat boast a large number and wide variety of 
programs and partners that may conflict with each 
other and that may pull teachers and administrators' 
time and energy in different directions. 33 These pro- 
grams and partners might be attractive "ornaments 
that bring attention to the school, but they provide 
little benefit because they fail to support common 
goals for school improvement and improvement in 
student learning. The opposite of the fragmented, 
Christmas tree school is one where the school and its 
partners are united behind one coherent vision and 
strategy for school improvement. 

Sixteen of the 19 partners we interviewed worked 
with schoolsthat worked with other partners, includ- 
ing afew with probation partners assigned bytheCPS 
central office. In someof these schools, external part- 
ners had agendas that werecomplementary and com- 
patibleto those of the An nen berg partners. In other 
schools, those agendas were not. In the latter schools, 
theAnnenberg partners we studied identified lack of 
coherenceand coordination among multiple partners 
asaseriousimpedimentto school improvement. 0 ne 
partner who worked in oneof these schoolsexclaimed 
in an interview: "It's a Christmas tree school, and it's 
crazy. [It's] crazy trying to make it work there." 

The partners we interviewed found that schools 
placed on academic probation by CPS central office 
were particularly susceptible to becoming Christmas 
trees. W hi le probation managers created the possibil- 
ity of conflicting improvement agendas, another part- 
ner described how some Annenberg partners might 
themselves have contributed to the Christmas tree 
phenomenon in Chicago. He recalled: 



What happened at the very beginning was that 
external partners were just looking for bodies, 
that's how I 'll put it, to put together a network. 

A lot of consulting types of firms that popped 
up that, I don't know, didn't seem very well es- 
tablished. I mean a lot of our schools got calls, 

"H i, I'm putting together thisnetwork. You want 
to tie in?" [For a school to be in a network put 
together in that way,] it would have been a 
C hristmas tree. It wouldn't have made a lot of 
difference. 

Several partners spoke about why it was so diffi- 
cult to work with schoolsthat lacked coherence. De- 
scribing the situation in a school on academic 
probation, one partner told us: 

The probation partner for a while was "X." It 
was like [the school was] getting double mes- 
sages. It was exactly theoppositeof what wewere 
talking about, so it made [work there] really, 
really difficult, very difficult. 

Annenberg partners said that they sometimes had to 
compete with other school partnersfor teacher^ time 
and attention. 0 ne partner said, "You could sit down 
and find out that there's so many people [from other 
external partners] trying to vieforthesamefew teach- 
ers who were really interested in doing something." 

When working with a Christmas tree school, some 
of the partners we interviewed tried to avoid conflict 
with other programs and partners. These partners tried 
simply to work in different and noncompeting areas. 
And sometimes that worked out well for the 
Annenberg partners. For example, one told us: 

0 ne of our schools had a partner in math and 
science, and we are addressing literacy and art, 
so we werejust kind of running along on two 
tracks. Also because the school is very consis- 
tent, working with both us and this other part- 
ner really wasn't a problem. 
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Another provided the following examples: 

One school had a partnership with [a math] 
program there. It was a very hands-on student- 
centered approach to math. It just supported 
whatever wedid. Another school brought in two 
years ago an out-of-state university partner to 
help with reading. H e had somehow come to 
some CPS meeting and connected with a prin- 
cipal there and I suggested we sit down at the 
table together. We sat down and I said, "What 
are you doing? H ow can the Annenberg sup- 
port what you aredoing?" 0 ncel heard hiscon- 
ceptual framework, it was not at odds with what 
the network philosophy was all about so it was 
not a problem. 

H owever, most partners said that they were more 
proactive to try to bring somecoherencetotheschools 
in which they worked. Fourteen of the 19 partners 
told us that they attempted to meet with other part- 
ners regu I arl y, to wo rk to coo rd i n ate p rogram s i n so m e 
constructive way. 0 ne partner explained thattheway 
in which heapproached the problem of coordination 
wasto help the school and its multiple partnersfocus 
on those things that were the most fundamental to 
the school and its improvement: 

I think one clear success factor has been to fo- 
cus on goals that are central to the mission of 
both the school and of the system to be some- 
thing other than another Christmas tree pro- 
gram. So, if what the schools must accomplish 
isimproving reading, give them a way to do that, 
that also [helps them address other issues like 
student] engagement in education. It becomes 
an effective [way to work with schools and other 
partners] because you are on a partnering mis- 
sion not a partner that iskind of distracting you 
from the mission. You are not using the schools 
to accomplish your goals in away that distracts 
them from theirs or vice versa. You are doing 
something that is central to your mission and 
central to their mission. It's real collaboration. 



Another partner described how complicated and dif- 
ficult this important task could be: 

We were very intentional about forming a rela- 
tionship with the other external partners and 
[our school planning team] worked with the 
principal to makesure that all thedifferent part- 
ners were represented inthat group. Iftheyhad 
somebody focusing on curriculum and instruc- 
tion or whatever it was, any kind of serious part- 
ner, then they were integrated into that 
[committee] so that it was not everybody doing 
separate work. The goal of that team wasto in- 
tegrate and coordinate things so that it aligned 
with the school improvement plan, and every- 
one was kind of moving in the same direction, 
but really wanted to encourage schoolsand make 
sure the actual people were sitting around the 
table, so that asthesediscussions rolled out, that 
they're i nvol ved. 0 ver the more recent years with 
probation, we had to step up integrating what 
wedo, and having real dialogues about that be- 
cause we had to share staff development time 
and all that kind of stuff. There was a lot of back 
and forth negotiation that goes on, but I think 
we consulted with each other a lot on how to 
best approach something in the school. 

As suggested by our earlier discussion of leader- 
ship, the partners we interviewed considered theprin- 
cipal to bea critical factor in their efforts to promote 
coordination and coherence. One of the partners ex- 
plained it this way: 

The partnership can't just be one of 50. There 
has to be some kind of coherent strategy for 
school change. If you have50 other partners they 
all have got to say, "This is how we connect to 
thiscoherent strategy for school change. Wecan 
add this or we understand what it is the school 
istryingtodo, and hereiswherewefit in." And 
there has got to be some leadership there that 
says if you don't fit in you are out, you can't just 
be a conglomeration of programs and pulling 
and tugging in various ways. 
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Some partners worked directly with their schools' 
principalsto help them develop thecapacity to bring 
coherence to their schools' improvement activities. 
One partner told us: 

Our network has tried to work with, or help 
principals make strategic decisions, but leaving 
the ultimate decision up to them, and saying 
well you don't have to get rid of these [many 
nonrelated] partners, but you might want to 
thi nk about this when you start pulling thisstuff 
in. We tried to dissuade them from the Christ- 
mas tree effect, you know. Sometimes they lis- 
ten and sometimes they don't. 

The Need for Resources 

A final factor that the partners identified as being 
important for school improvement was the presence 
of adequate resources over a sustai ned period of time. 
The partners we interviewed identified three types 
of resources as being particularly important to their 
efforts to promote school improvement. These re- 
sources were time, money, and people. Each isdis- 
cussed below. 

Sufficient Time 

The partners we i ntervi ewed spoke about the i m por- 
tanceoftimein two ways. The first wasthetimeavail- 
able to work with school personnel, particularly 
teachers. M any partners found that the shortness of 
theschool system's teacher workday, coupled with the 
substantial amount of responsibility teachers have, 
posed serious constraints on their ability to find time 
to work with teachers. 34 Some partners confronted 
what one called a "time clock" culture that made it 
difficultto gain teacher participation in improvement 
activities past the end of the regular school day. Oth- 
ers pointed to the aversion they encountered from 
some teachers to "overtime" work. Partners recalled 
that efforts to "release" teachers from classroom du- 
ties to participate in improvement activities proved 
complicated, asour later discussionsof partner^ com- 
ments about substitute teachers and CPS adminis- 
trative procedures attest. 



In addition to the challenges of finding adequate 
time to work with school personnel during and be- 
yond the regular the school day, the partners we in- 
terviewed thought about the importance of time in a 
second way. They spoke at length about how long it 
takes to achieve change in schools and how impor- 
tant it was to be able to work with schools over an 
extended period of time. All of the partners with 
whom we spoke stressed that they needed multiple 
years of sustained work in any one school to get re- 
sults. One partner told us: 

We used to say when we began ten years ago, 
"It's going to take us six years." Although we 
were kind of on target, it's going to take us 
six yearsto really get started, becauseof all of 
the political things that you have to take on. 
And they are all important things. They are 
all critical victories that we have had along 
that span of time. 

T he partners with long-term experience working 
in schools had perhaps the greatest insight concern- 
ing the amount of time successful partnering work 
for school improvement required. 0 neof these part- 
ners recounted the long route his work has taken: 

It took 10 yearsto get some teachers on board 
and Annenberg was only around six. I felt like 
the six-year mark with [our organization], we 
wereheading real solid, and you needed to keep 
going. At sixyearswedidnthavethestrong lead- 
ership that we have now, and wedidn't have the 
total buy-in that we have now from the teach- 
ers, and wedidn't havethedepth of understand- 
ing about curriculum that we have now. At six 
years we were beginning to get that pretty solid 
base, but we needed to fill in more people. We 
needed to pull in more teacher leaders, and we 
needed to be really dealing with the curriculum 
and the assessment. You couldn't deal with the 
assessment in the first six years. If you are creat- 
ing curriculum you are not assessing it the first 
couple of years. You are just trying to create it 
and maybe you will stumble into someformsof 
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assessment that work, but chances are you will 
not. It just took a while to get there. If I was 
goingto start An nen berg over again, I thinkthe 
external partners were a good idea and weshould 
have had ten years and not five. I think for the 
schools you need a solid ten years to really feel 
comfortable. 

Another partner pointed to the need for a long time 
frame in order to address the interlocking elements 
of a more comprehensive school reform plan: 

We talked about culture change. I think the 
thing that we learned is that you can't focus on 
a plan and expect the entire culture to change. 
It'slikeall thefood groups. It's principals, teach- 
ers, parents, and kids, and if you don't try to hit 
all of those you are maybe successful in chang- 
ing one of the elements, but you can't get [cul- 
ture] change in five years. 

Sustained Financial Support 

Partners credited the Challenge with providing long- 
term financial support that created opportunities for 
sustained work with schools. Such lengthy funding 
was uncommon for many of the partners. And while 
they believed that their Annen berg grants gave them 
resources essential to their work with schools, some 
found that the relatively small sizeof those grantsdid 
not providethem levelsof resources to support their 
work adequately. So me partners were able to supple- 
ment their Annenberg grants with other resources. 
For other partners, their Annenberg grants were the 
primary financial resources with which they had to 
work. 

Of significant concern to many partners was their 
ability to sustain funding post-An nen berg. M ost part- 
nersdid not see easy ways to replace their Annenberg 
grants in order to continue their work over the long 
term. When weconducted our 2001 interviews, many 
of the partners with whom we spoke were working 
with their schoolsto securecontinuation funding but 
with varying success. One partner was working with 
hisschoolsto help them decide how to carry on parts 
of their Annenberg work, even though they had not 



secured ongoing outsidefunding. Some partners were 
wo rki n g d i recti y wi th pri n ci pal s an d L SC s to f i n d ways 
to real locate their schools' discretionary fundsto con- 
tinue to support Annenberg work. Reported one 
partner: 

We are exploring now. There aren't a lot of 
sources of funding out thereto continuethings 
that somebody else has started. 0 ur focus has 
been on strengthening those principals and lo- 
cal school councils, and those cadres of teachers 
that we have. It's going to be very difficult to 
maintain. Our emphasis right from day one has 
been to try and work with theLSC and the prin- 
cipal because they are the policy makers, and 
they aretheoneswho can state this is what [we] 
need to do and this is what we're putting in the 
funds for. 

Another partner described some modest successfind- 
ing funds to continue Annenberg work within its 
network schools' budgets: 

Well, theschools are actually funding a continu- 
ation of the network. We had proposed this last 
spring to the principals, and they all had talked 
to their staffs and all of them very much wanted 
to continue some kind of interaction. And so 
they are paying for it, and what we're doing is 
we are going out to the schools now what 
amounts to about one day a month. 

Other partners told us of the difficulties they 
were experiencing trying to replace Annenberg 
grants with grantsfrom other outside sources. They 
found it difficult to piece together many small 
grants into a sufficient pool of resources. One of 
these partners told us: 

Forusthrough small grantsto recreate the bud- 
get that we had with Annenberg is going to be 
hard. We have about 15 grant requests out and 
I have heard on two of them, so we now have 
$35,000.00 out of a budget. We had three 
schools. We need $300,000.00. So we will see 
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what happens there. There is an outsidechance 
that the Annenberg [Foundation] in Pennsylva- 
nia is going to pick up some of the networks. 
They asked usto writeonepagedescriptionson 
what we have accomplished in our networks. If 
that were to come through, we would be back 
on thetrack, and we might be fine. Anyway, it's 
a little bit up for grabs. 

Several other partners talked about how difficult it 
wasto secure grants from other funders to continuea 
pre-existing program or network. The partners per- 
ceived that most local funding sources are reticent to 
fund long-term activity. T hey saw further that most 
sources preferred to fund something they had a hand 
in creating, something of priority to them. One of 
these partners observed: 

Then on thefoundation level, it'sjust kind of 
hard so far. We've gotten some private foun- 
dation funding, but you know they don't re- 
ally want to fund this kind of long-term 
program. You know they would want to find 
something new. 

The Chicago Challenge did offer a grant-writing 
workshop to partners, but many of the partners we 
interviewed wished that the Challenge would have 
done more to prepare them to find post-Annenberg 
funding. During our 2001 interviews, one partner 
observed: 

I think if Annenberg had set themselvesup from 
the very beginning to train us on how to [find 
other sources of funds] we'd be so much farther. 

So now people are kind of in crisis mode. You 
know there are somefolkswho arejust now start- 
ing to think about "Uh oh [our grant expira- 
tion is] 30 days away. W hat arewegoingto do?" 

Human Resources 

In addition to timeand financial support, the inter- 
viewed partners were well aware of the importance of 
human resourcesto their work in schools. T hey spoke 



in interviews of the importance of stability in staff 
and leadership in introducing and sustaining school 
improvement initiatives. They also spoke about the 
importance of school-level leadership, trust, teacher 
professional community, and teacher commitment to 
and participation in partners' activities. The schools 
with which the partners worked varied considerably 
with regard to the strength of these human resources 
(seeTables 7, 9, and 10). 35 

T he partners spoke of two other human resource 
issues that they considered important to promoting 
school improvement.Thefirst, related to creating time 
to work with teachers, concerned substituteteachers. 
The second issue concerned hiring coordinators or 
other project staff to work in schools. 

A major challenge to external partners was the 
shortage of substitute teachers to cover classrooms so 
that regular teachers could participate in professional 
development and other activities the partners spon- 
sored. Almost one-third ofthepartnersweinterviewed 
were emphatic about this issue. Even though there 
was money to pay for substitutes— partners had allo- 
cated Annenberg funds to pay for them— the CPS 
system that supplied substitutes was unreliable. One 
partner complained, "There weren't bodies. Subs 
wouldn't show up." Another partner described the 
problems he experienced with substitutes this way: 

The whole substitute thing, there is so much 
that our teachers wanted to do, but we couldn't 
get subs to cover them. It's horrendous. We 
would have to cancel some things at the last 
minute or only half the people showed up be- 
cause they couldn't get subs in. 

Sometimes school principals had little choice but to 
insist that their teachers not attend partner^ school- 
improvement activities because substitute teachers 
were not thereto work with students in their absence. 

Some partners said they became so frustrated with 
the system of supplyi ng substitute teachers that they 
considered alternative strategies. 0 nepartner remem- 
bered what worked successfully for an earlier reform 
strategy in Chicago. 
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Project CANAL, for example, when they were 
here, had a cadre or pool of subs that they then 
sent up. They were regular, [the] samesubsthat 
weretrained. And Annenberg didn't do that. You 
know, that would have been a good thing to do. 

0 neof the partners told us that he attempted to build 
his own pool of substitute teachers but was not suc- 
cessful because he could not overcome high turnover 
within that group. 

The partners we interviewed also discussed the 
challenges involved in hiring personnel to help them 
run programs in schools. Partners said the/ demanded 
that thei r employees bededicated, confident, and flex- 
ible in working with teachers and principals. Most 
said that they required teaching experience of some 
kind, or at the very least experience in schools on 
another level, such as school counselor or parent vol- 
unteer. Ten of the partners we interviewed tried to 
hire staff with prior experience in Chicago. The part- 
ners told us that consequently, most people who 
worked full-time for them came from the schools or 
had been closely related to schools in their work. In 
one partner organization, "Everybody, everybody was 
a teacher. T here was not one person that hadn't been 
in a classroom or that didn't keep a teacher certifi- 
cation." But the partnersfound that hiring people 
from schools posed its own difficulties. Recalled 
one partner: "There is a tension [in] taking people 
out of schools. You don't want to take people out 
of the schools that are leading important work in 
the schools." 



T he partners we interviewed indicated that there 
had been a substantial amount of movement of per- 
sonnel from schoolsto partner organizations and back 
again to schools. Many of the consultants and coor- 
dinators that partners employed were "teachers-on- 
loan." This was a personnel category in CPS that 
allowed teachersto work outsidethei r schools but keep 
their seniority, pay scale, and benefits through the 
school system. H owever, C PS policy permitted teach- 
ersto hold this state for only two years. This contrib- 
uted, partners told us, to a "revolving door" of 
personnel and destabilized relation ships they worked 
hard to develop with schools. One partner recalled 
how he and his organization tried to work around 
the problem and maintain the staff needed for his 
work with schools: 

The Board has been horrible. Every year they 
have told us they are taking them back. [Oneof 
our staff members] is just a genius at working 
the board. If it weren't for him we wouldn't have 
teacher consultants. H e has found ways of cov- 
ering them, having them appointed to different 
schools. Wesaid at least let us have them for the 
duration of the Annenberg project. And they 
havea two year I i mit. We kept them but it's been 
very creative. We've had to put them on rolls of 
schools. Keeping our consultants has been one 
of the most difficult things every single year. It 
has been: go to the Board, figure out a lie, work 
with someone who you find will let you add 
him or her to a school's budget. 
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V. What Partners Need to Do Their Work Well 



A nnen berg external partners served asa source 
of support for local school development. Like 
wise, the partners themselves often needed 
support and an environment conducive to working 
effectively with schools. In this section of the report, 
we present partners' observations about the forms of 
support they felt they needed to work effectively with 
schools. Certainly, the partners we interviewed con- 
sidered the presence of resources discussed in the last 
section of the report to be sources of support in their 
work with schools. H ere, however, we focus on three 
other supports they spoke of— professional support 
from external sources, in this case, the Chicago 
Annenberg Challenge; opportunitiesfor networking 
with schools and other external partners; and sup- 
port from the CPS central office. 

Professional Support 

Theexternal partners we interviewed readily acknowl- 
edged the importance of their own learning and de- 
velopment to their ability to serve school swell. And 
they pointed to the importance of external sources 
that could support them. For these partners, theChi- 
cago Annenberg Challenge was their primary, com- 
mon source of professional support. Indeed, the 
Challenge sponsored a number of events for schools 
and partners during its six years of operation. As 
shown in T able 11, these events included a wide vari- 
ety of workshops, retreats, and presentations. Pro- 
grams designed specifically for external partners 
included discussions of the CPS probation process 
and its implications for Annenberg schools, discus- 
sions with CPS central office personnel on budgetary 
issues, workshops on the grant renewal process for 
networks requesting additional funding, using data 
for school improvement decisions, interpreting Con- 
sortium survey results, and network-to-network ex- 
changes. The Challenge also provided more direct, 
one-on-one support for most partners. 

For the most part, the external partners we inter- 
viewed appreciated the Challenge's efforts to support 



them. Many were positive but others were more 
equivocal about the value of this support. Seven 
partners, including all three community-neighbor- 
hood partners, had only positive thingsto say about 
what they learned at Challenge partner events. 0 ne 
told us: 

I have never gone to an Annen berg- sponsored 
activity, event, workshop that wasn't so worth 
my time. I've gone to a lot of workshops spon- 
sored by a lot of di fferent o rgan i zati ons over the 
years and I can tell you noneof them compare 
with the Annen berg Project. They're always, re- 
gard I ess of subject, excel lent. The reason isthey 
give you practical information. And it'swhatyou 
can really use and really need. I felt I ike it wasn't 
one of those where you get tons of theory, but 
nothing useful. Like going to the fundraising 
workshop, I got a folder that said, "here's what 
they're looking for in the introduction, here's 
what they want to hear in this." 0 kay, well if I 
write a grant I 'll takethat folder out, you know, 
something that I can actually sit and use.They're 
not lofty idea kind of workshops. 

Some partners pointed to workshops on media re- 
lations, data-driven decision-making and research 
findings, and various inspirational guest speakers as 
particularly helpful. Another partner said: 

I really appreciated theeventsthat they planned 
over the years. T he events that they have given 
have always been very well thought out. There 
are two or three events a year that are very hel p- 
ful, very instructive, very pleasant, very elegant. 

T hey don't stand on anything. T hey meet in a 
really nice place, and we have really nice food 
and they think about who thepresenters are and 
the quality of it. They put a lot of effort into 
that and it has paid off. I definitely have ben- 
efited from that enormously. 
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Table 11: A Sample of Events Sponsored by the Chicago Annenberg Challenge 



Date 


Event 


Speaker/ Topic 


October 1996 


CPS Probation Policies at 
CAC offices 


Meeting of external partners to discuss 
implications of probation policies for 
Annenberg schools 


Spring 1997 

(multiple 

sessions) 


Time, Size and Isolation at 
Chicago Teachers Center 


Workshops for networks on core 
Annenberg principles 


June 1997 


CPS High School Redesign 
Policies at CAC offices 


Meeting of high school principals and 
external partners to discuss high school 
policy 


October 1997 


Fall Celebration for networks 
and external partners at 
University of Chicago 
Downtown Gleacher Center 


Gloria Ladsen-Billings of the University 
of Wisconsin on teaching urban children 


February-May 

1998 


Network Roundtables at 
CAC Offices 


Networks with similar interests meet to 
share ideas and expertise 


May 1999 


Planting Roots: Cultivating 
Change at Field Museum of 
Natural History 


Network presentations of 
accomplishments, plus luncheon 
speaker Jeannie Oakes of UCLA on de- 
tracking 


November 1999 
and March 2000 


Sustaining Reform at CAC 
offices 


Meetings of external partner 
organizations on securing funding after 
Annenberg 


December 1999, 
April 2000, 

July 2000 


Using and Sharing Data for 
School Improvement at 
various venues 


Series of retreats for external partner 
organizations on making data-driven 
decisions 


January 2001 


Authentic Intellectual Work 
at Summit Executive Center 


Workshops for external partners and 
principals on creating expectations for 
high-quality student work 



Eight other partnersweremorecritical about Chal- 
lenge-sponsored events. These partners wanted to have 
more opportunities for partner-to-partner exchange 
and more follow-up to workshop experiences. Said 
one partner: 

Thisisnotto cast aspersionson anyonebecause 
we [partners] do the same damn thing. These 
events were not interactive. They were kind of 
touted as things that would be, and you got ev- 
erybody in a room and somebody made a pre- 
sentation; that seemed to bethetypical kind of 
format. I think in some cases it was just fine, 
but it isalso a chanceto swap somestories among 
the partners, but it didn't seem likea lot of that 
went on. 



M any partners thought that the manner in which 
theChallenge scheduled its events compromised their 
effectiveness. They felt that the Challenge was not 
sensitive to theschool calendar or thedifficulties with 
scheduling events for network schools on short no- 
tice. 0 ne partner remarked: 

Wefound that it was co n ti n u al I y f ru strati n g th at 
things like deadlines or meetings or whatever 
would drop down on us with little notice and 
our lives were so complicated, to say nothing of 
the teachers' or the principals' lives. That was 
often really difficult to manage, that I think was 
the one downside. 
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Several partners who wanted to includeteachersand 
principalsin variousevents were stymied by schedul- 
ing: "[The Challenge] frequently scheduled things at 
atimewhen peoplefrom theschoolscouldn't go, and/ 
or they would give you last minute notice and you 
couldn't turn on a dime." 

Partners also pointed to the importance of their 
relationships with thei r C hallenge"program offi cers, " 
those members of the Challenge staff who were re- 
sponsible for working directly with them and their 
networks. They considered these relationships ascru- 
cial sources of support. In general, the partners we 
interviewed portrayed thesupport they received from 
their program officers as helpful. As one partner re- 
ported: 

I really like working with the staff. Our pro- 
gram officer was very good initially about com- 
ing out to our schools and getting a feel for what 
the program was like. We had to negotiatea lot 
of things about the budget or about the pro- 
gram over the years and she has been very help- 
ful and supportive. She engaged us in the 
External Partners Advisory Group from thebe- 
ginning, so we were ableto play a rolethere so I 
think it has been quite positive. We always had 
access to [the Challenge's Executive Director] if 
we wanted to talk to him. 

At the same time, many of the partners were frus- 
trated by the lack of time program officers had for 
on-site school visits. As we noted in the final techni- 
cal report of theChicagoAnnenberg Research Project 
and earlier in this report, the C hallenge was staffed 
by a small number of people who had responsibility 
for working with large numbers of partners and 
schools. 36 1 1 was difficult for staff to find timeto work 
much with partners individually in their schools and 
thiswasa problem that the partners understood. Still, 
they wanted more from the program officers. 

W hile the partners were grateful for the support 
they received through Challenge events and from 
Challenge staff, they saw much of the administrative 
and reporting requirements imposed by theC hallenge 
as burdensome. Several complained that these require- 



ments constrained their work. A nearly universal com- 
plaint from the partners was about the mandatory 
semiannual progress reports. One of the partners said, 
"Twicea year was too much. Weunderstand why they 
did it but once a year would have been fine." An- 
other partner also found the reporting to be a great 
deal of work, but with an up-side: 

I found it not busy work. I found that the re- 
flecting that I had to do was pretty important, 
so I haven't felt it excessive. It's burdensome, but 
it's not excessive. There is a meaningful purpose. 

M any partners expressed disappointment that they 
did not receive mo re feed back than they did on their 
reports. Partners wanted thefeedbackto assist in their 
own development and to help them work mo re effec- 
tively with schools. 0 ne partner told us: "People need 
to feel that what they are being asked to do is valued 
and evaluated and reviewed. I think a bit more peri- 
odic feedback would have helped us." Feedback was 
important not only to the partners and their organi- 
zations but to the schools. This partner summed up 
the feeling of many other partners: 

We never received any comment on reports. It's 
niceto befunded and refunded at a higher level, 
but we have never had feedback that we can take 
to the schools and say, you see they think you 
should do more of this or less of that or what- 
ever. TheC hallengewas so far in thebackground 
that it seemed to theschool partners that all these 
grants were simply coming from the external 
partners. 

For some partners, the hands-off monitoring style 
of the program officers carried some benefits. The 
absence of close supervision provided a level of au- 
tonomy that some partnersthought was itself a source 
of support and impetus for partner^ learning and 
development. This partner explained: 

When we started working with theAnnenberg 
Project, unlike other grants that I've done that 
are very rigid, very "this is what you do, this is 
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what you don't do," the Annenberg Challenge 
was kind of out there, almost "figure it out, fig- 
ure out how to do this." Sometimes we scratched 
our heads and tried to figure out how are we 
supposed to do this, and meet what Annenberg 
wants us to do? I wish they would give us more 
guidance and more leadership. In a sense it was 
very empowering. You might not have seen it 
then, but I really, really see it now. It was very 
empowering. 

0 ne final area of support is worth noting. As we 
discussed earlier in this report, theChicago Annenberg 
Challenge was organized around a broad set of prin- 
ciples of collaborative local school development. It 
specified neither goals for school improvement nor 
programsorprocessesforschoolsand partnersto fol- 
low. Many, but not all, of the partners we interviewed 
thought that guidance on school improvement goals 
and processes was an important sourceof support and 
one that was missing for the most part in working 
with the Challenge. These partners wished that they 
had had moredirection from Annenberg. According 
to this partner: 

[The Challenge might have] suggested some 
models for operating. People were pretty much 
left tabula rasa. A lot of good things came out 
of it, but I think if you had these research- based 
'what work£ models..., so that everybody is not 
reinventing the wheel. 

Another partner said: 

1 think they would have been well advised to 
start with a series of seminars on the process of 
school change, during which they presented or 
they had skilled teachers present the best state 
of the art thinking on the process of school de- 
velopment. I mean there is so much out there 
in terms of research. I would say [it would have 
helped] if they had given a series of very reflec- 
tive seminars on the process of school change 
and got at it from many angles, to get people 
thoroughly grounded in what'savailableand not 
only to come to lectures or something, but to 



be involved in a series of reflective discussions 
about it. 

Networking 

The partners we interviewed considered opportuni- 
ties to network with schools and with other partners 
to be important sources of support and development. 
Although theoriginal intent of creating networkswas 
for schools to learn from each other, several partners 
explained how working with a variety of schools as- 
sisted in their own development. Different schools 
posed different issues to the partners and challenged 
them in different ways. To some partners, working 
with a network of schools, some which might be suc- 
ceeding and others which might not, provided a source 
of motivation. Reasoned one partner: 

I think that it's good [to work in a network] 
because as external partners when something's 
not working in one school, yet there's celebra- 
tion in another school, it gives you enough 
motivation to comeback. When things are go- 
ing poorly, if I were to have to go through some 
of thecrap I went through, and only see it from 
oneschool's perspective I would probably have 
given up a long time ago. Because dark is re- 
ally dark. So I think that something good is 
happening here, and it motivates you to keep 
on trying where it's not good it's more moti- 
vating. 

T he partners we interviewed also saw networking 
with other partners as an important source of sup- 
port and development. As mentioned earlier, the part- 
ners generally placed high value on opportunities to 
interact with other partners. T hey believed that shar- 
ing ideas and experiences and engaging in joint prob- 
lem solving would help them develop the capacity to 
work more effectively with their schools. They felt 
that they could be more effective by pooling their 
collective wisdom about school development. 

The partners we interviewed generally wanted 
greater opportunitiesfor networking with other part- 
ners than they experienced with the Challenge. They 
desired better communication among partners, especially 
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those with similar network foci. A simpleway to have 
promoted this, suggested one partner, would have 
been sharing reported findings and accomplishments. 

It would have been fun and interesting for ev- 
eryone to have received a booklet of sections of 
peoples' reports, thegood sections. Again, some- 
thing down and dirty, to cut out two pages of 
our report on teacher collaboration and there 
are three pages of somebody else's or a half of a 
paragraph. A sense of what other people were 
doing, and how they stack up with other people. 

It would not have been expensive or compli- 
cated to do. 

A Supportive Central Office 

A third source of support that Annenberg partners 
considered vital to their work with schools was the 
CPS central office. They understood well that the 
central officecould bea crucial sourceof support for 
local school development by streamlining adminis- 
trative procedures and by developing programs and 
policies that were consistent with, even enabling of, 
local improvement efforts. While a school system's 
central office could serve as a source of support, it 
could also bean obstacle. For most of the partners we 
interviewed, the CPS central office was seen as an 
impediment to their work to promote local school 
improvement. 

N early every partner we interviewed had negative 
things to say about theC PS central office and how it 
complicated and failed to support their work. Their 
complaintsfocused on a number of different policies 
and procedures ranging from the uncertain and un- 
steady nature of decision-making to what they con- 
sidered an overemphasis on standardized testing. We 
identified such policies and procedures as 
"countervailing system forces” in our 2000 report on 
external partners. 37 0 ur last interviews with the part- 
ners in 2001 revealed that these matters remained of 
serious concern through the end of the Challenge. 

Partners spoke at length about the challenges of 
processing financial transactions through the central 
office. O ne partner brought to the interview a two- 
inch thick folder of paperwork she had collected from 
one simple transaction. Another partner told us: 



"T here are bureaucratic problems, for just something 
as simple as loading the money. All money that we 
use to pay for an extended day or parent mentors, or 
career service, or off ice staff extended hours hasto go 
through the Board, and that has never gone well." 
Another partner said: "To change anything, the lines 
were so ridiculous, the requirements, that it wouldn't 
get donefor months and we would lose out." 

One very common complaint, voiced here by one 
partner, was the changing nature of central office di- 
recti ves to the schools: 

If [they] could get their act together. T here are 
so many last minute mandatesthat comedown, 
or we will plan something and then all of a sud- 
den testing time has changed. The whole pro- 
cess of getti ng approved to visit. Someti mes some 
schools seem to be right on top of it and other 
schools miss their window of opportunity be- 
cause they couldn't get permission from thedis- 
trict to do afield trip in timeor something like 
that. If they want to implement something, do 
it and give it time to work and do it right and 
don't keep changing every two or three years. 

Some partners complained about the disruption to 
their programs or plans by the central office. One 
partner provided this particular example: 

Thereisalwaystheconstant kind of pressureor 
tension between the practices that we are help- 
ing people to employ, and then these directives 
that they are being given from the board and 
the central office. T here is not any level in the 
school where that is not felt. The principals in 
particular are aware of this, but the literacy fa- 
cilitator and teachers can know that it's one 
way..., then the board comes along and gives 
them somethingthat looks similar and they call 
it the same thing. They give them directives 
about how to carry it out that are totally anti- 
thetical to the way that it should be carried out 
yet they have to do it that way because now they 
are being required to do that. You havethis sort 
of thing going on all thetime. 
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This partner told us about the sweeping effects of 
central office actions on individual schools: 

There is not this confidence in the central of- 
fice that it is well meaning, because there are 
political forces that are contributing to these 
countervailing things. It ranges from replacing 
the principals, to wanting to seize greater con- 
trol, to mandating after-school programs with 
no thought to putting in these bridge programs 
in these transition schools. Tremendous sums 
of money are put toward things that no one at a 
grassroots level has any kind of involvement in. 

H ere you got these 200 schools put on this spe- 
cial reading probation, and what do they do? 
They send out somebody to the school to kind 
of do an audit. The person coming to do the 
audit is not an educator, knows nothing really 
about schools and you are a victim of them and 
what they think about your school . T hose ki nds 
of things, those are the cou ntervai ling things that 
go on, and people just want to go, "Uggh!" I 
think it's real strong. I wish I had an answer. 

The most disconcerting of all the central office 
policies to the partners was high stakes testing and 
probation for schools. All of the partners we inter- 
viewed mentioned these policies at one time or an- 
other in their interviews. M ost partners spoke quite 
negatively about these policies' effects on their work 
in schools. 0 ne partner observed: 

We do not believe that standardized testing 
should betheend all that determines everything 
at the school level. And while we very much 
believein collaboration, not competition, in peer 
assessment and self-assessment, in viewing kids' 
growth over time through portfolios, that often 
has to take a back seat for several weeks while 
[the schools] prepare kids for that test. 

Another partner told us: 

If you want to have any kind of creative counter 
balance to theemphasison testing and the nega- 
tive effect, I mean that is such a powerful nega- 
tive force, over the years in conversations we've 



had with schools. Even schools that aren't on 
probation will come to meetings and say, "We 
can't do that because we have to focus on our 
reading test scores.” You cannot argue with them 
because if their test scores slip then suddenly 
you've got this whole horrible situation. 

Of the system's probation policy, yet another part- 
ner said: 

There is a fear of going on probation and what 
you have to do to makesurethat you don't, that's 
where we have had problems. "Wecan'tdothis, 
sorry, until February we are in test prep." 0 ne 
school almost shuts down. 

Still another partner observed: 

Probation would go hand in hand just with the 
emphasis and the hyper-sensitivity to and ob- 
session with test scores, and standardized tests 
and the testing system in Chicago, which is so 
oppressive for teaching critical thinking and 
teaching the way those of us who are doing re- 
search and working in this field and in 
Annenberg. T hat is not a positive condition. 

Several partners saw some consolation for work- 
ing with schools that were not on academic proba- 
tion. Asthis partner described: 

In an ideal world the board would be a sup- 
port, especially in a school system as big as 
C hicago, not a source of dictates. T he advan- 
tage of it being so big is that there was really 
nobody messing with us. N obody really knew 
what we were doing. 

The partners we interviewed agreed on several forms 
of assistance that would have aided in their efforts to 
work with the school system. Partners wanted to form 
a united front that might beableto soften the effects 
of somecentral office policies. 0 ne partner observed: 

I think that the getting some kind of agreement 
with CPS would have been really helpful to sup- 
port the direction of the Annenberg initiative, 



Working for School Improvement 37 



and to not have these variousdemandscoming. 
Similar to what the charter schools have, some 
kind of waiver of some sort. 

These partners thought that an intermediary organi- 
zation, such as the Challenge, could serve as a liaison 
or a buffer, or challenge C PS in situations where its 
policies threatened their work at theschool level. 0 ne 
of thepartnersweinterviewed expressed a disappoint- 
ment shared by others that the C hallenge did not do 
more: 



It would have been great if somehow Annen- 
berg had been able to establish a really wonder- 
ful working relationship with theBoard. I think 
that would be the single one thing. "Yes, you 
are an Annenberg school. Yes, you can be ex- 
cused from this. You can have leeway. You want 
to do this, then we will bend our rules a little 
bit." So that there could be so much flexibility 
to do things. A lot more could have happened. 
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VI. On the Future of External Partners as 
Agents of School Improvement 



E ach of the Annenberg partners we studied 
spent fiveor six years working with their net- 
work^ schools. When we interviewed them 
for the last time in 2001, we asked them to draw on 
thei r experiences and tel I us what they bel ieved exter- 
nal partners could contributeto school improvement 
in the years to come. In this last section we discuss 
the roles that Annenberg partners thought external 
partnerscould perform to promoteschool improve- 
ment and their sensethat for all thetimethey spent 
working with schools, for their successes and fail- 
ures, they emerged from the C hallenge with greater 
capacity to serve schools in the future. 

In its initial request for proposals, the Chicago 
Challenge laid out a number of possiblefunctionsof 
external partners that included "brokering outside 
resources, providing coalition/networking support, 
organizing community involvement and advocating 
on behalf of the schools." 38 Although they didn't al- 
ways use the same language when describing thecon- 
tributionsthey thought external partnerscould make, 
thepartnersweinterviewed were clear in thei r collec- 
tive belief that external partners could play key roles 
in promoting school improvement. Referring to the 
problemsthat manyschoolsfacein tryingto improve, 
even if they have abundant resources, oneAnnenberg 
partner summed up the contributions that partners 
can make this way: 

This "physician heal thyself" attitude is a 
tough thing to do. I think you can say to a 
school "H ere is $2 million additional dollars. 

Do what you have to do to get yourself to 
here." Everybody [in a school] is already in- 
volved full-time. Who isgoingto takethetime 
to plan, hire people, manage $2 million dol- 
lars in a reasonable fashion? 

Among those we interviewed, external partners were 
the answer. 



Roles External Partners 
Can Play 

Despite the differences in their organizational types, 
their previous work with schools, andthefoci of their 
network activity, the partners we studied largely agreed 
that external partnerscould perform several impor- 
tant roles to promoteschool improvement. These roles 
included (a) helping schools create a focused vision 
to guide their development efforts, (b) providing ex- 
ternal expertise and sharing it with schools through 
professional development activities, (c) connecting 
schoolsto external resources to support school devel- 
opment, and (d) advocati ng for their schoolsand help- 
ing to buffer them from outside forces that might 
compromisethei r i mprovement efforts. T he partners 
we interviewed did not claim that they had been par- 
ticularly successful in performing each of these roles. 
Instead, they saw promise for partner contributions 
in each of these areas. 

Creating a Vision for 
School Improvement 

First and foremost, every partner with whom wespoke 
described creating a vision asoneof the primary roles 
external partners could perform to promote school 
improvement. The partners spoke about how they 
tried to bring to their network schools an outside 
perspective, a focus, and a view of what the school 
might look like in the future that school personnel 
usuallyfound difficultto imagineon theirown. Part- 
ners often spoke of their role as a catalyst to bring 
new ideas and perspectives to schools, create an im- 
perative for schoolsto act upon those ideas and per- 
spectives, and sustain that imperative over time. 

For example, one partner observed that it was very 
important to school developmentto have"someout- 
side ideas, some exposure to [new] ideas, and some- 
body who's going to convene people around those 
ideas." This partner argued that bringing new ideas 
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into schools and convening people around them was 
"not going to happen spontaneously." It required guid- 
ance and resources, which external partners could 
provide. Another partner put it this way: 

An external partner can serve as a catalyst and a 
change agent in a school, [an] external impact 
on a closed system. If the intention is to open 
up the system to new ideas you have to have 
something that disrupts theequilibrium, an ex- 
ternal variable will at least shift the pattern in 
the school. If it can also shift it in a way that 
helps the school focus on what it is trying to 
accomplish, then that's better. It introduces, at 
least potentially, a kind of permission to try 
something new that changes the politics of the 
school. It gives everybody permission to act a 
different way. 

In particular, the partners we interviewed thought 
that external partners could offer schools a long-term 
vision of what they could strive to become. Partners 
spoke of school personnel as being understandably 
preoccupied with immediate concerns, but they ob- 
served that by coming into a school from the outside, 
an external partner could offer a broader, more fu- 
ture-oriented perspectivethan simply getting through 
theday. Reflecting this view, a partner explained: 

Schoolsdo not strategize. T hey arejust respond- 
ing to the immediate. They are not really ca- 
pable of long-term vision. I think an external 
partner can say "Okay, we are at this point. We 
need to take it to this point." And [a partner] 
can monitor that. Whereas the schools, [they 
can't do that], unless they can get out of that 
putting out fires everyday mentality. 

Partners we interviewed believed not only that ex- 
ternal partners could bring new ideas for school im- 
provement, they thought that external partners could 
serve assourcesof support for putting those ideas into 
practice. One partner described an example of the 
kind of support an external partner can bring: 



You need somebody who isgoingto be free from 
the constraints of the system. [In] any of our 
three schools right now, everybody in those 
schools is stretched beyond thelimit, absolutely 
totally stretched. So those who have reached a 
sense of our vision arejust going to be so im- 
peded by anything else that they haveto do, and 
so having somebody [like a partner], you can 
come in and catalyze things. 

Providing External Expertise 

M ost partners saw thei r schools as places fu 1 1 of hard- 
working people who weretryi ng thei r best to i mprove 
but had limited knowledge about what to do differ- 
ently. 0 ne of the partners we interviewed observed: 
"M any times theschoolsthemselvesaredoingthebest 
they can. If they could do things differently they 
would." M ost partners saw the provision of external 
expertise as a crucial role for external partners. 0 ne 
of the partners explained it this way: 

External partners are really vital because they 
are a wholeother sourceof consciousness. T hey 
do a lot of the work and training, and they are 
very connected to a lot of current thinking in 
education. A lot of them come from universi- 
ties, so they are very well read and they go to 
conferences a lot. They network and they are 
pretty well informed about someof the best stuff. 
Some have based their whole careers on being 
school developers, so they are specialty people, 
and theschool is not about to takethison them- 
selves. 

0 ne partner explained an advantage that most part- 
ners have is thei r abi I ity to identify the programs and 
practices that have the greatest potential for success: 

1 think that the quality of the programming, 
the 'bang for the buck' that you are going to get 
is on average going to be better coming from 
[external partners] because [they] havethetime 
and the resources and the human capacity to 
really focus on what is out there that's really 
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working and be selective about bringing it to 
the schools based on the actual outcomes of 
those programs. 

Several partners considered it most effective if part- 
ners brought expertise that was absent in a school 
rather than duplicateexpertise already present. Look- 
ing at this issue from a school's perspective, one of 
the partners we interviewed madethe poi nt this way: 
"If you are working with somebody externally, it just 
makes more sense if you choose a partner that has 
expertise that is not in the school. I think [the part- 
ner can] add a lot of value that [way]." 

Connecting Schools to 
External Resources 

In addition to expertise, the partners we interviewed 
believed that external partners could provide schools 
with another valuable resource— the ability to help 
them make connections to other organizations, 
groups, and individuals outside of the schools' own 
purview. Through these connections, schools might 
beableto gain accessto new ideas and leverage addi- 
tional financial, material, human, and political re- 
sources to support development. 

One type of connection that several partners 
thought could be provided was to link schools with 
other schools through networks. Some partners saw 
great potential in developing networks to diffuse in- 
formation and resources among the schools. As one 
partner told us: 

T he schools getting together, they don't do that 
on their own. They need someoneto help them 
come together to bring the whole group of 
schools these outside ideas, this additional vi- 
sion. The schools can't manage that networking 
on their own. 

N etworki ng was seen by a number of partners as a 
way to pool resources, to expose schools to ideas and 
information that they themselves lacked. For example, 
one partner we interviewed portrayed these benefits 
this way: 



[Schools can] draw on each other's strengths. 
[They] can compliment each other in ways that 
a smaller group or smaller number of people 
working in one institution can't. And that goes 
for lots of different things, ideas, energy. 0 ne 
school might have a stronger principal, might 
have a stronger LSC, stronger parent group 
so that they havea lot of ideason how to work 
with those groups that those other schools 
might not. 

Some partners saw that building connections 
among schools had the additional benefit of creating 
a new sense of accountability. The joint work that 
schools do with one another and with their partners 
might create a sense of mutual responsibility and ob- 
ligation to act in good faith upon the ideas they de- 
velop together and the decisions they make together. 
One partner observed: 

It helps keep the schools accountable to one 
another, to what they've decided, to what they 
say they're going to do, and so they come to- 
gether and they talk about it and they argue 
about it and share ideas, and if they didn't have 
that process to go through I think that it would 
be too easy to get sloppy. 

The community-based partners we interviewed 
pointed to therolethat external partners could play 
to connect schools to their local communities, infus- 
ing "community dynamics" into theschools. Accord- 
ing to these partners, such connections can have 
multiple benefits. T hese benefits include developing 
greater community understanding of and support for 
schools, helping schools better understand the chil- 
dren and communitiesthey serve, and linking schools 
with potentially valuable human, political, and ma- 
terial resources. M any of the partners we interviewed 
saw their schools as relatively disconnected from 
theircommunities. Asonecommunity-based part- 
ner observed, "I don't think most of our schools 
act at a community level." Several partners saw these 
connectionsashaving benefits for communities as well. 
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Put simply, stronger schools promote stronger com- 
munities. One of the partners reflected: 

An external partner in this case is a very con- 
structive force for changethat I think can bean 
asset to that community that you belong to. It 
can give you a community you belong to that is 
stronger than what you can do on your own, 
and it brings different kinds of resources into 
the system. 

Advocacy and Buffering 

TheAnnenberg partners we interviewed also believed 
that external partnerscould be advocates who worked 
on behalf of their schools with various outside agen- 
cies. External partnerscould serve as buffers that might 
help schools stay thecoursein their development ef- 
forts and to maintain the vision that partners helped 
schools to develop. As one of the partners we inter- 
viewed observed, "School change is going to happen 
slowly, and it's going to get disrupted by all kinds of 
stuff." Even as they said they needed buffers them- 
selves, most of the partners thought that they could 
help schools weather the disruptions caused by ad- 
ministrative changes, teacher turnover, and changing 
policies and procedures from the CPS Central Of- 
fice. 

Partners saw "outside" status as being particularly 
advantageous to external partners, providing them the 
leeway to act when schools themselves might be con- 
strained politically. As one partner described: 

T h ere's that helpful guardianship, the buff eri n g, 
being able to intervene in places where people 
cannot. T he idea of the partner not being con- 
nected to the school, it helps a lot. T hat the re- 
lationship brings both safety and safety to take 
a risk. 

Enhanced Capacity to Serve 

Beyond their observations about the roles that exter- 
nal partnerscould play to promote school improve- 
ment, the partners we interviewed saw themselves as 
better able to serve schools in the future because of 
what they had learned from working in the Chicago 



Annenberg Challenge. The partners claimed to have 
developed a great deal during their fiveor six yearsof 
work and they told us that they planned to use their 
new knowledge and skills as they moved into their 
post-Annenberg work. T heir reflectionson their learn- 
ing and development suggest that they saw themselves 
as a legacy of sortsof theC hallenge — a stronger, more 
experienced, more capable resource for school im- 
provement in Chicago. 

After years of work with their schools, the 
Annenberg partners we interviewed told usthat while 
their overall vision of strong schools and their goals 
for school improvement remained consistent, most 
were not able to foresee the exact course they needed 
to take to achieve their goals. Their routes included 
numerous detours, obstacles, and surprises. And it 
was in their encounters with problems that the part- 
ners' found the impetus for their own learning and 
development, and, according to the partners, for im- 
proving their work with schools. Time after time, this 
theme was replayed in the interviews. 

When theyspokeof theirown development, those 
partners that had worked with schools before the 
Challenge said they had learned to sharpen their foci 
or add newdimensionsto their partnering. Most did 
not report great changes in their overall philosophy 
or direction. They talked about being "more inten- 
tional, more focused" on thesamemission, or chang- 
ing the way that they delivered professional 
development, but the focus of that development re- 
mained intact. Several of these partners came to rec- 
ognize the power of taking teachers and school 
administrators to visit "model" schoolsand classrooms 
as a strategy for improvement. 

By contrast, those partners that had not worked 
with schools in long-term partnerships before 
Annenberg thought that the experience had pro- 
foundly changed their organizations and their rela- 
tionships with schools. These partners, all from the 
cultural institutions and neighborhood groups, 
claimed to have learned a great deal about working 
with schools. Asa result someclaimed to have shifted 
their approach from addressing community concerns 
"from the outside-in" to working "from the inside- 
out," becoming more directly involved with teachers 
and their professional development. They said they 
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learned more about how to motivate teacher partici- 
pation in school improvement. 

While one of the primary sources of learning and 
development was their day-to-day experiences work- 
ing with schools, many partners established formal 
means of feedback and evaluation that also served as 
sources of learning. M ore than half of the partners 
we interviewed hired outside evaluators and all con- 
ducted someform of internal evaluation. M ost com- 
monly, they used surveys, interviews, and focusgroups 
to assess teacher, parent, and student engagement in 
their school improvement efforts. T hey also used data, 
such astest scores, attendance rates, and dropout rates. 
They tallied tangible changes, such as books circu- 
lated in literacy programs, assessments completed, and 
numbers of teachers attending professional develop- 
ment sessionsorworkingwith classroom consultants. 
They conducted observations of teachers at work, in 
class, or in meetings. Several engaged the school staff 
as reflective partners in their evaluation efforts by 
having them make formal public presentations, con- 
duct school or network self-assessments, create and 
review portfolios, and present poster sessions on their 
activities. 

0 ne partner described how it employed a variety of 
evaluative strategies: 

We're constantly monitoring how many teach- 
ers are participating in professional development. 
Wearedoing follow up with them. We'rewatch- 
ing the scores; we're looking at participation in 
community service. So we're all sort of constantly 
doing our own self-monitoring. 

Another partner made use of several sources of data 
from inside and outside its schools: 

Test scores, moving off the bottom quartile, 
mobility rate, attendance rates, school climate, 
we have several measures of that. We use the 
Consortium data. We have our own internal 
assessment of school climate. Wesurveyand we 
will ask principalsabout changing teaching be- 
havior, like, "How many teachers are using co- 



operative I earn in g?H ow many teachers are con- 
sidering developmental pathways?" And things 
like that. 

Several partners described the ways they learned 
about their own effectiveness from the assessments 
they used with thei r schools and teachers. 0 ne part- 
ner told us: 

When the schools do a self-study, we help them 
look at the data and analyze what they've 
achieved and what they haven't achieved. It's also 
a pretty strong information for us about what 
we've accomplished with them, and where we 
are road blocked, and where we've needed to 
strengthen what we do. 

Another partner described: 

We set up a process of visiting a classroom and 
then within a day or two, having a debriefing 
with the teacher to talk about what we have 
observed and where theteacher can go next with 
this, and we type up all of our notes. We are 
getting avery good pictureof where[our initia- 
tive is] right now, and where the strengths and 
limitations are, and where it needs to go next. 

So, as far as the classroom process is concerned, 
that's the kind of evaluation wearedoing now. 

Partners also had their own internal processes for 
evaluating their work with schools. 0 ne partner said: 

We have done some formal retreats ourselves. 
Twiceayear, wesystematicallysay, "T his is what 
wearedoing. This is what we are finding. This 
is what we like. This is what wedon't like." And 
moving from that perspective. T hen we've had 
facilitators come in to help us through that pro- 
cess. 

Another partner described an involved self-assessment 
processthat included internal and school-based evalu- 
ation: 

[There is a quarterly meeting at our organiza- 
tion] and it'sopen season for your projects there. 
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People can ask you why you are doing what, 
and what was successful and what wasn't. We 
have all day staff meetings where we basically 
analyze and strategize. We have them once a 
quarter, and then there is a summer retreat. We 
also get an awful lot of analysis and feedback 
from the schools themselves. We have a lot of 
meetings with our constituents. We feel very 
strongly that after wedo something people will 
give immediate feedback, we will debrief. 

Finally, several of the partners credited the Chi- 
cago A n n en berg C h al I en ge fo r creat i n g a co n text co n - 
duciveto partner development: 

I think the most positive, and this has been sig- 
nificantly positive about Annenberg, isthatthat 
they have really have been partners in mission. 
They have allowed thisto bean ongoing learn- 
ing exchange. I think Annenberg being a real 
partner in mission has allowed us to redesign 
[our work with schools] as it needed to be, to 



kind of learn from where things were going. I 
think the fact that Annenberg was open to say- 
ing wewill trust you to figureoutwhat isneeded 
and to experiment with that instead of saying, 
well if you weren't investing in reducing class 
size then you are not a real network or what- 
ever. That has really allowed and encouraged 
some experimentation and innovation. 

Another partner put it this way: 

The things that have turned out to be transfor- 
mational are things that we only conceived of 
midstream, and thefact that Annenberg has been 
willing to support that and that it has been a 
six-year development process have been a big 
advantage, because frankly I think if we had to 
accomplish this in two or three years it never 
could have happened. Ittooktwo orthree years 
just to get people knowing each other well 
enough to be willing to work together. 
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VII. Summary and Concluding Remarks 



T hepurposeof this report was to give voice to 
the insights and perspectives of a sample of 
C h i cago A n n en berg extern al part n ers an d to 
convey what they believed that they learned from 
working in schools about their improvement. We 
began this report by introducing Annenberg's ex- 
ternal partners and the foci of their work. We also 
described the various contexts in which they worked 
to promote school improvement. 

T he primary sectionsof this report focused on what 
partners bel ieved they learned about promoti ng school 
i m provement, what support they thought they needed 
to work effectively with schools, and what they 
thought external partners could contribute to school 
improvement in the future. The partners we studied 
stressed the importance of four major factors in pro- 
moting school improvement— leadership, communi- 
cation and trust, coherence and coordination, and 
adequate and sustained resources. They pointed to 
the importance of professional support, networking, 
and a supportive central officein theirown work with 
schools. The partners we studied believed that exter- 
nal partners could play a number of important roles 
in supporting school improvement in the years to 
come. They considered external partners to be im- 
portant sources of vision and impetus for school im- 
provement. They saw them as external sources of 
expertise. And, they believed that partners could serve 
as advocates and buffers to protect and sustain local 
initiative. Finally, these partners pointed to theirown 



learning and development during the course of their 
work with Annenberg schools, concluding that they 
garnered an enhanced capacity to serve schools better 
in the future. 

We noted in the methodology sidebar in Parti that 
this is a report based on self-reports and perceptions 
of the partners we studied. We mentioned that, as a 
whole, all of theexternal partners receiving Annenberg 
grants tallied morethan 200 years of experience work- 
ing with schools. 0 ur sample of 19 partners spent a 
cumulated total of nearly 100 years working with 
schools. Whilewedid not collect data to directly cor- 
roborate what they told us, the partners' perspectives 
on working with schoolsarequite consistent with data 
we collected in other strands of the Chicago 
Annenberg Research Project and reported in its vari- 
ous technical reports. 39 Their perspectives are also 
quite consistent with the literature on school change 
that we cited in those reports. 

If nothing else, this report helps us understand 
better the individuals and organizationsthat worked 
long and hard as Annenberg partners on behalf of 
school improvement. H owever right or wrong they 
may be in their observationsand interpretations, how- 
ever effective or ineffective they may have been in 
their work, their ideas and insights are useful for 
understanding how those working with schools"on 
the ground" see the task of school improvement 
and for the role of partners to promote improve- 
ment in the future. 
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Endnotes 



1 H allet, Chapman, and Ayers (1995). See also Sconzert, 
Shipps, and Smylie (1998). 

2 See Smylie and Wenzel (2003). 

3 See Shipps and Sconzert with Swyers( 1999b). See also the 
Chicago Challenge’s directors of grants and project records. 

4 N ewmann and Sconzert (2000). 

5 See Smylie et al. (1998), Wenzel et al. (2001), Smylie and 
Wenzel (2003). 

6 These strategies aredescri bed in greater detail in N ewmann 
and Sconzert (2000). 

7 N ewmann and Sconzert (2000). 

8 Bullough and Kauchak (1997), Lieberman and Grolnick 
(1996), Pennell and Firestone (1996). 

9 Annenberg Institute for School Reform (1998), page8. 

10 Shipps et al. (1999b). 

11 Annenberg Institute for School Reform (1998), pp. 5-6. 

12 M ore detailed information about the Challenge’s grant 
making can be found in Shipps et al. (1999b). 

13 M ore detailed information about theamountsof money 
distributed by the Challenge can be found in Smylie and 
Wenzel (2003). 

14 Among the schools in the project’s field research sample, 
the average annual budget in 1999 was approximately 
$3,810,000. SeeN ewmann and Sconzert (2000) and Smylie 
and Wenzel (2003). 

15 See also Smylie et al. (1998). 

16 For more information on school reform in Chicago, see 
Shipps, Kahne, and Smylie (1999a), Bryk et al. (1998), and 
FI ess (1991, 1993). For a detailed analysis of the influence 
of Chicago school reform on the development of the Chi- 
cago Annenberg Challenge, see Shipps et al. (1999b). 

17 Wenzel et al. (2001). 

18 Wenzel et al. (2001). 



19 Timar and Kirp (1987). 

20 Fullan (2001); N ewmann and Wehlage (1995); Smylie, 
Conley, and M arks (2002). 

21 Hall and Hord (1987). 

22 Smylieand Wenzel (2003). 

23 The methodology by which these measures were con- 
structed and analyzed is explained in detail in Smylieand 
Wenzel (2003). 

24 Smylieand Wenzel (2003). 

25 Wenzel et al. (2001). 

26 N ewmann and Sconzert (2000). 

27 See also Wenzel et al. (2001). 

28 N ewmann and Sconzert (2000), p. 53. 

29 Smylieet al. (1998). 

30 N ewmann and Sconzert (2000). 

31 See Smylie and Wenzel (2003). 

32 N ewmann, Smith, Allensworth, and Bryk (2001) docu- 
ment the academic benefits that schoolsachievefrom coher- 
ent instructional programs. 

33 Bryk et al. (1998). 

34 For a more indepth discussion of lack of time for profes- 
sional development and school improvement in theChicago 
Public Schools, see Smith (2000). 

35 See also Smylie and Wenzel (2003) for a more indepth 
discussion of human and social resource capacities in Chi- 
cago Annenberg schools. 

36 Smylieand Wenzel (2003). 

37 N ewmann and Sconzert (2000). 

38 H allet et al. (1995). 

39 See Smylie and Wenzel (2003). 
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The Chicago Annenberg Research Project is a five-year program of the Consortium on Chicago 
School Research to document and analyze the activities and accomplishments of the Chicago 
Annenberg Challenge. The project focuses on four related areas of inquiry. 



1. 0 utcomes for students. Change in academic achievement, including 
basic skillsand higher levels of learning. Also change in social attitudes, conduct, 
and engagement among students in Annenberg schools. 

2. School development. Improvement in key organizational conditions of 
Annenberg schoolsthat affect student learning. T hese conditions include school 
leadership, parent and community partnerships, student- centered learning cli- 
mate, professional development and community, and quality instruction, as well 
as the Challenge's organizational themes of time, size, and isolation. 

3. Networks. H ow networks, their external partners, and other change mecha- 
nisms promote the development of Annenberg schools. 

4. Larger contexts needed to support school development. H ow the C hal- 
lenge develops as an organization to support networks and school development. 
H ow the broader institutional contexts of Chicago affect the development and 
accomplishments of the Challenge. 



The project's research design includes longitudinal surveys and case studies, multiple levels of 
analysis, and comparison groups. Data are collected from several sources including surveys of 
teachers, principals, and students; observations of schools and classrooms; classroom tasks and 
student work products; interviews; documentsof Challenge activities; and administrative records 
from the Chicago Public Schools. 



